-- Logs begin at Tue 2022-10-04 04:54:18 UTC, end at Tue 2022-10-04 06:02:19 UTC. -- Oct 04 05:34:02.581125 dv-cinder-849143-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 05:34:02.589106 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 05:34:02 2022] *** Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: nodename: dv-cinder-849143-10-iscsi Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: machine: x86_64 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: clock source: unix Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: pcre jit disabled Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: detected number of CPU cores: 4 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: current working directory: / Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: detected binary path: /usr/bin/uwsgi-core Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: your processes number limit is 47680 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: your memory page size is 4096 bytes Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: detected max file descriptor number: 2048 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: lock engine: pthread robust mutexes Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: thunder lock: enabled Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 05:34:02.597547 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 05:34:02.631534 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: Python main interpreter initialized at 0x559d1ae839c0 Oct 04 05:34:02.631534 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: python threads support enabled Oct 04 05:34:02.631534 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: your server socket listen backlog is limited to 100 connections Oct 04 05:34:02.631534 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: your mercy for graceful operations on workers is 90 seconds Oct 04 05:34:02.631842 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 05:34:02.631944 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: *** Operational MODE: preforking *** Oct 04 05:34:02.632212 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: *** uWSGI is running in multiple interpreter mode *** Oct 04 05:34:02.632212 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: spawned uWSGI master process (pid: 112364) Oct 04 05:34:02.632405 dv-cinder-849143-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 05:34:02.638175 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: spawned uWSGI worker 1 (pid: 112365, cores: 1) Oct 04 05:34:02.638175 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: spawned uWSGI worker 2 (pid: 112366, cores: 1) Oct 04 05:34:02.638175 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 05:34:03.286592 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 05:34:03.303467 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 05:34:04.368384 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:34:04.368384 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: from cryptography.utils import int_from_bytes Oct 04 05:34:04.368970 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:34:04.368970 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: from cryptography.utils import int_from_bytes Oct 04 05:34:04.371153 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:34:04.371153 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: from cryptography.utils import int_from_bytes Oct 04 05:34:04.371575 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:34:04.371575 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: from cryptography.utils import int_from_bytes Oct 04 05:34:06.843745 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 05:34:06.844341 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 05:34:06.844699 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 05:34:06.844800 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 05:34:06.844891 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 05:34:06.844981 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 05:34:06.845076 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 05:34:06.845167 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 05:34:06.845254 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 05:34:06.845341 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 05:34:06.845477 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.845691 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.845808 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.845921 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.846133 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.846261 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.846486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.846590 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.846815 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.846911 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.847126 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.847231 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.847444 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.847544 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.847760 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.847846 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848085 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848185 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848343 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848437 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848655 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848742 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.848980 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-10-iscsi {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.849080 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-10-iscsi {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.849325 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.849463 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.849632 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.849768 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.849939 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.850081 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.850283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.850421 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.850572 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.850707 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.850900 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.851027 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.851204 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.851307 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.851701 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.851810 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.852138 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.852242 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.852445 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.852544 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.852754 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.852856 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.853097 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.853194 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.853399 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.853491 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.853705 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.853801 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854019 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854120 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854360 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854461 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854682 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854780 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.854991 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.855086 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.855383 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-10-iscsi {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.855476 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-10-iscsi {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.855699 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.855789 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.856009 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.856101 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.856320 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.856412 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.856727 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.856833 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857036 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857127 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857345 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857437 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857661 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857753 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.857994 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.858087 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.858332 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.858433 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.858660 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.858745 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.858977 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.859068 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.859294 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.859393 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.859615 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.859722 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.859914 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860000 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860222 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860318 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860527 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860619 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860842 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.860929 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.861145 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.861242 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.861449 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.861540 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.861695 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.861780 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862002 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862103 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862350 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862446 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862670 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862781 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.862992 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863090 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863241 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863372 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863497 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863593 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863793 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.863886 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.864113 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.864198 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.864421 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.864522 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.864728 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.864821 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865056 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865142 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865365 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865463 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865672 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865757 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.865978 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.866074 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.866307 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.866403 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.866613 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.866703 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.866929 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867021 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867240 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867327 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867563 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867659 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867871 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.867964 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.868189 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.868280 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.868580 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.868666 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.868830 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.868914 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.869135 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.869230 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.869472 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.869556 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.869790 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.869896 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.870096 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.870199 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.870438 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.870583 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.870760 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.870866 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871067 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871153 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871374 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871468 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871679 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871843 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.871998 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872083 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872330 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872414 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872634 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872730 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872880 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.872972 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.873179 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.873271 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.873482 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.873574 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.873798 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.873889 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.874104 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.874238 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.874434 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.874532 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.874740 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.874824 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875038 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875150 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875342 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875436 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875647 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875731 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.875950 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876043 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876256 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876349 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876560 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876644 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876865 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.876956 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.877166 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.877261 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.877468 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.877559 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.877771 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.877856 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.878073 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.878180 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.878417 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.878502 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.878735 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.878829 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879043 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879134 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879348 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879447 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879654 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879766 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.879961 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.880055 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.880277 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.880368 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.881107 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.881230 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.881418 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.881544 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.881744 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.881871 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.882054 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.882204 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.882387 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.882515 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.882707 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.882834 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883018 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883145 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883329 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883454 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883650 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883774 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.883953 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.884076 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.884264 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.884385 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.884583 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.884703 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.884896 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885037 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885210 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885307 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885518 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885618 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885826 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.885936 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.886133 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.886248 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.886465 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.886562 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.886774 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.886869 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.887082 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.887186 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.887381 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.887475 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.887703 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.887797 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888022 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888117 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888332 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888433 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888641 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888742 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.888946 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.889049 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.889263 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.889355 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:34:06.889600 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.889692 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.889934 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.890038 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.890364 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.890439 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.890605 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.890710 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.890937 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891079 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891269 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891391 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891589 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891684 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891897 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.891992 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.892220 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.892380 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.892543 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.892659 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.892854 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.892977 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.893167 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.893277 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.893476 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.893586 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.893794 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.893934 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.894122 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.894342 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.894479 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.894603 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.894760 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.894856 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.895079 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.895166 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.895404 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.895490 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.895719 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.895817 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.896111 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.896742 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.896963 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.897061 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.897289 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.897385 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.897605 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.897691 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.897946 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.898030 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.898317 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.898423 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.898633 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.898729 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.898960 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899048 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899282 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899377 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899594 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899686 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899905 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.899997 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.900214 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.900301 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.900554 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.900646 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.900872 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.900968 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.901186 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.901272 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.901502 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.901588 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.901816 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.901902 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.902162 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.902252 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.902473 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.902569 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.902783 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.902877 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.903094 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.903181 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.903408 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.903493 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.903717 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.903811 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.904052 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.904138 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.904367 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.904452 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.904689 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.904782 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905003 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905088 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905317 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905409 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905634 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905727 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.905946 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906038 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906281 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906370 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906598 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906696 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906900 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.906985 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.907203 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.907286 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.907505 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.907590 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.907814 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.907899 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.908116 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.908200 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.908433 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.908519 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.908760 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.908845 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.909065 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.909150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.909396 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.909489 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.909704 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.909789 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910015 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910100 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910352 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910448 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910662 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910747 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.910971 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.911069 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.911282 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.911367 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.911591 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.911713 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.911920 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912014 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912246 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912333 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912558 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912651 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912867 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.912967 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.913191 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.913277 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.913495 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.913579 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.913800 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.913893 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.914115 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.914264 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.914450 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.914536 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.914762 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.914897 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.915077 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.915170 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.915385 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.915473 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.915704 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.915791 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916016 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916102 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916328 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916412 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916661 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916747 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.916990 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.917081 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.917295 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.917379 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.917616 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.917701 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.917938 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918022 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918280 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918384 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918586 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918670 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918895 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.918981 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.919198 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.919291 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.919500 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.919593 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.919803 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.919888 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.920108 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.920202 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.920408 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.920493 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.920710 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.920802 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921017 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921109 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921321 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921407 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921626 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.921950 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922085 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922283 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922371 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922587 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922672 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922889 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.922984 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.923190 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.923275 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.923529 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.923614 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.923832 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.923918 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.924171 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.924256 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.924502 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.924594 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.924821 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.924948 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.925143 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.925228 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.925456 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.925553 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.925772 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.925866 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.926083 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.926267 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.926443 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.926543 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.926758 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.926852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.927074 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.927160 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.927425 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.927518 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.927737 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.927823 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928056 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928142 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928366 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928461 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928688 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928773 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.928998 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.929084 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.929318 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.929411 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.929623 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.929716 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.929937 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.930029 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.930298 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.930387 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.930632 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.930717 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.930946 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931031 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931268 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931396 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931581 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931666 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931896 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.931989 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.932205 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.932291 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.932514 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.932599 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.932827 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.932912 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.933135 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.933220 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.933454 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.933545 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.933764 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.933858 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.934082 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.934218 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.934418 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.934512 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.934740 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.934891 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935051 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935146 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935368 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935456 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935673 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935766 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.935985 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.936072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.936309 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.936399 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.936639 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.936732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.936949 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937040 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937259 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937344 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937580 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937677 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937888 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.937982 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.938218 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.938306 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.938530 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.938615 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.938836 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.938963 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.939138 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.939232 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.939446 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.939532 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.939758 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.939849 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940065 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940151 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940371 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940456 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940673 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940757 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.940984 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.941078 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.941292 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.941376 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.941593 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.941677 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.942193 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.942299 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.942508 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.942608 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.942829 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.943429 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.943659 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.943753 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.943982 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.944068 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.944304 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.944395 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.944607 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.944701 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.944910 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945003 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945230 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945318 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945538 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945637 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945848 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.945937 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.946166 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.946255 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.946473 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.946568 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.946814 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.946909 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.947126 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.947211 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.947429 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.947523 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.947744 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.947828 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.948066 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.948159 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.948378 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.948464 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.948690 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.948775 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949000 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949123 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949312 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949398 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949635 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949721 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.949947 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.950043 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.950279 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.950378 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.950593 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.950680 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.950903 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951002 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951221 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951314 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951521 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951613 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951842 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.951937 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.952153 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.952244 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.952461 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.952549 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.952772 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.952937 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.953076 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.953162 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.953385 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.953470 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.953699 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.953786 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.954297 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.954385 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.954624 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.954710 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.954941 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.955029 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.955262 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.955347 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.955604 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.955703 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.955925 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956020 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956252 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956346 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956579 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956667 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956895 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.956982 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.957201 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.957294 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.957509 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.957602 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.957812 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.957909 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.958115 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.958265 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.958449 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.959132 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.959317 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.959408 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.959624 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.959718 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.959929 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960014 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960236 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960328 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960541 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960627 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960842 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.960929 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.961146 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.961240 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.961447 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.961581 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.961760 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.961846 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.962063 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.962209 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.962451 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.962564 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.962701 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.962799 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963022 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963116 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963328 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963413 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963634 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963719 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.963934 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964032 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964238 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964332 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964577 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964662 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964882 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.964968 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.965215 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.965347 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.965543 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.965627 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.965882 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.965968 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.966210 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.966301 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.966518 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.966606 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.966836 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.966930 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.967141 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.967227 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.967444 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.967538 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.967747 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.967831 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968052 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968137 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968359 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968453 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968659 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968743 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.968967 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969060 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969279 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969372 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969585 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969670 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969893 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.969979 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.970227 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.970329 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.970530 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.970617 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.970833 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.970918 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.971143 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.971236 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.971452 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.971550 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.971755 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.971851 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972056 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972143 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972366 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972450 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972670 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972767 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.972973 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973059 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973278 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973363 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973581 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973667 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973894 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.973987 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.974236 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.974341 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.974545 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.974632 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.974850 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.974936 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.975155 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.975286 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.975463 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.975562 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.975767 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.975853 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.976087 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.976172 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.976394 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.976488 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.976698 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.976783 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977000 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977086 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977308 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977465 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977609 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977694 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977913 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.977998 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.978241 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.978341 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.978564 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.978650 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.978879 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.978964 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.979184 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.979271 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.979489 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.979573 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.979792 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.979879 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.980095 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.980187 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.980395 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.980480 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.980700 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.980786 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981002 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981089 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981303 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981606 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981690 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981906 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.981991 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.982230 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.982331 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.982551 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.982681 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.982857 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.982942 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.983159 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.983248 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.983461 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.983555 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.983761 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.983846 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.984101 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.984194 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.984406 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.984499 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.984761 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.984845 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.985064 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.985151 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.985376 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.985468 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.985691 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.985783 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986001 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986088 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986336 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986425 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986648 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986740 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.986951 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987036 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987265 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987359 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987576 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987669 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987886 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.987978 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.988187 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.988279 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.988489 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.988574 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.988806 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.988891 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.989115 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.989200 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.989425 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.989520 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.990257 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.990368 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.990599 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.990686 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.990917 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991002 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991220 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991313 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991527 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991619 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991839 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.991931 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.992145 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.992240 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.992453 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.992545 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.992758 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.992844 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.993069 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.993164 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.993380 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.993465 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.993691 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.993777 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994001 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994094 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994336 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994425 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994640 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994726 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.994951 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995037 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995256 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995340 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995558 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995681 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995879 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.995965 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.996187 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.996281 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.996489 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.996584 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.996797 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.996891 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.997099 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.997184 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.997408 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.997503 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.997709 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.997801 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.998130 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.998303 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.998601 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.998717 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.998802 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.998881 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.999068 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.999156 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.999379 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.999472 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.999692 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:06.999781 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.000007 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.000092 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.000321 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.000416 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.000625 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.000710 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001036 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001128 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001348 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001449 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001656 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001741 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.001970 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002065 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002298 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002385 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002604 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002691 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002913 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.002998 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.003236 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.003322 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.003539 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.003623 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.003840 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.003932 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.004145 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.004238 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.004462 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.004548 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.004765 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.004858 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.005083 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.005169 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.006049 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.006171 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.006386 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.006490 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.006694 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.006781 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.007107 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.007195 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.007418 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.007578 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.007731 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.007837 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.008052 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.008146 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.008374 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.008459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.008697 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.008796 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009002 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009095 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009399 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009622 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009716 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.009943 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010029 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010287 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010376 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010599 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010696 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010912 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.010998 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.011216 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.011312 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.011537 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.011624 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.011856 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.011985 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.012169 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.012257 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.012489 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.012577 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.012899 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013039 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013220 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013306 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013528 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013621 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013849 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.013936 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.014195 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.014295 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.014502 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.014588 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.014806 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.014891 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.015114 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.015212 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.015418 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.015503 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.015720 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.015814 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016043 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016137 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016346 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016431 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016656 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016741 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.016964 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017061 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017270 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017356 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017572 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017658 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017872 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.017959 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.018213 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.018303 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.018519 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.018604 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.018838 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.018926 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.019149 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.019235 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.019466 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.019559 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.019785 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.019909 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.020090 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.020176 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.020410 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.020502 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.020716 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.020803 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021040 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021145 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021347 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021434 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021649 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021735 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.021990 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.022094 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.022317 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.022415 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.022637 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.022723 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.022964 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.023099 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.023289 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.023385 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.023597 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.023683 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.023927 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024013 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024247 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024344 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024565 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024657 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024872 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.024957 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.025186 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.025281 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.025507 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.025593 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.025810 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.025903 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.026112 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.026262 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.026446 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.026533 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.026750 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.026835 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027053 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027139 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027356 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027442 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027662 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027754 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.027963 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028049 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028264 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028350 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028565 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028660 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028883 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.028968 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.029185 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.029287 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.029505 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.029599 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.029813 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.029898 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.030118 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.030267 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.030443 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.030542 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.030747 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.030841 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.031088 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.031173 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.031393 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.031488 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.031723 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.031809 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032033 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032131 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032358 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032453 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032680 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032766 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.032998 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.033083 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.033316 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.033401 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.033633 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.033718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.033949 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.034041 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.034288 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.034379 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.034604 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.034696 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.034915 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035019 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035229 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035319 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035545 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035640 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035864 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.035949 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.036376 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.036467 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.036729 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.036827 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037045 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037141 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037357 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037444 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037671 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037758 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.037986 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.038081 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.038328 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.038418 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.038638 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.038724 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.038949 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039047 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039261 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039347 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039569 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039655 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039895 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.039989 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.040217 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.040306 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.040539 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.040624 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.040872 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.040959 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.041188 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.041273 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.041501 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.041596 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.041816 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.041910 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.042130 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.042285 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.042508 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.042611 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.042824 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.042912 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.043131 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.043217 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.043445 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.043537 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.043757 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.043841 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.044069 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.044154 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.044382 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.044473 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.044691 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.044776 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045003 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045096 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045313 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045399 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045623 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045709 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.045933 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.046026 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.046272 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.046362 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.046588 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.046674 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.046909 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047069 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047243 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047353 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047562 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047652 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047872 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.047967 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.048184 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.048271 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.048497 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.048584 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049012 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049106 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049328 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049417 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049664 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049750 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.049989 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.050075 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.050337 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.050423 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.050656 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.050743 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.050973 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.051068 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.051306 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.051424 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.051610 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.051702 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.051918 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.052014 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.052725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.052858 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053050 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053152 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053356 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053443 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053677 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053763 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.053989 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.054083 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.054321 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.054410 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.054640 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.054725 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.054949 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.055047 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.055478 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.055566 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.055827 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.055914 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.056145 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.056240 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.056472 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.056559 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.056797 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.056890 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.057114 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.057210 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.057422 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.057517 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.057745 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.057832 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.058053 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.058158 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.058389 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.058476 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.058705 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.058792 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059016 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059102 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059319 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059412 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059626 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059712 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.059937 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060023 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060247 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060376 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060552 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060653 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060863 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.060955 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.061163 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.061257 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.061489 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.061583 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.061795 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.061881 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.062101 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.062256 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.062432 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.062532 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.062745 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.062831 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063047 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063131 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063351 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063444 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063656 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063741 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.063960 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064045 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064269 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064355 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064572 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064656 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064879 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.064965 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.065184 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.065278 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.065496 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.065582 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.065854 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.065938 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.066187 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.066277 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.066499 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.066599 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.067099 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.067187 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.067404 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.067497 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.067705 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.067791 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.068562 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.068677 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.068876 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.068970 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.069200 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.069287 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.069513 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.069607 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.069824 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.069918 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.070184 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.070284 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.070840 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.070953 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.071037 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.071123 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.071353 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.071440 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.071675 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.071771 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072008 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072101 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072342 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072429 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072651 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072739 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.072958 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073042 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073263 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073347 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073587 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073673 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073898 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.073983 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.074233 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.074324 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.074545 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.074634 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.074855 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.074941 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.075178 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.075292 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.075474 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.075566 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.075783 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.075868 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.076091 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.076186 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.076399 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.076497 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.076708 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.076799 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077015 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077153 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077324 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077412 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077631 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077716 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.077941 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.078030 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.078278 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.078368 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.078618 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.078704 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.078938 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079025 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079254 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079347 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079569 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079663 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079884 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.079970 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.080194 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.080279 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.080501 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.080631 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.080809 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.080903 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.081114 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.081208 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.081428 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.081523 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.081755 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.081843 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.082065 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.082169 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.082397 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.082496 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.083059 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.083148 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.083376 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.083461 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.083742 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.083841 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.084066 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.084155 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.084379 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.084466 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.084703 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.084788 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085024 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085117 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085335 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085430 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085657 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085743 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.085968 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.086055 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.086323 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.086424 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.086660 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.086749 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.086990 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.087078 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.087314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.087409 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.087621 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.087708 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.087927 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088014 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088232 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088325 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088539 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088633 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088856 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.088942 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.089164 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.089257 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.089466 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.089553 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.089768 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.089854 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.090078 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.090193 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.090414 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.090507 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.090720 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.090816 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091025 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091111 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091326 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091411 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091633 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091720 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.091936 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092023 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092238 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092323 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092539 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092632 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092840 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.092927 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.093143 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.093236 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.093445 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.093539 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.093794 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.093886 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094053 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094155 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094379 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094477 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094684 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094771 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.094986 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.095072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.095287 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.095381 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.095616 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.095702 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.095948 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096033 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096261 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096359 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096582 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096667 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096892 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.096977 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.097214 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.097300 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.097523 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.097608 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.097843 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.097928 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.098178 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.098278 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.098495 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.098591 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.098803 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.098888 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.099158 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.099257 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.099475 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.099563 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.099791 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.099878 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.100107 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.100195 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.100421 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.100515 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.100732 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.100821 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.101039 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.101124 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.101367 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.101451 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.101695 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.101789 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102002 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102094 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102353 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102439 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102673 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102768 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.102993 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.103078 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.103308 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.103393 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.103621 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.103709 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.103949 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104035 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104259 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104351 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104572 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104672 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104882 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.104969 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.105192 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.105278 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.105504 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.105591 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.105819 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.105913 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.106130 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.106249 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.106463 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.106551 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.106780 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.106875 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.107095 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.107256 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.107422 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.107515 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.107745 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.107833 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.108055 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.108150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.108380 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.108465 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.108705 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.108803 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.109050 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.109148 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.109361 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.109447 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.109702 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.109786 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110034 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110121 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110376 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110464 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110690 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110775 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.110995 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.111082 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:34:07.111236 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 05:34:07.111328 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 05:34:07.264336 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO dbcounter [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Registered counter for database nova_api Oct 04 05:34:07.264543 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO dbcounter [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Registered counter for database nova_api Oct 04 05:34:07.285392 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_db.sqlalchemy.engines [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.286994 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_db.sqlalchemy.engines [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.292129 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writer thread running {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.293626 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writer thread running {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.348588 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.context [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57801ef0-8805-4133-b9bc-7641eae48053(cell1) {{(pid=112366) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 05:34:07.350101 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.context [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57801ef0-8805-4133-b9bc-7641eae48053(cell1) {{(pid=112365) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 05:34:07.352935 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:34:07.353411 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:34:07.353970 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_concurrency.lockutils [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:34:07.354464 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_concurrency.lockutils [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:34:07.354973 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:34:07.355695 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:34:07.356021 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_concurrency.lockutils [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:34:07.356122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:34:07.356743 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_concurrency.lockutils [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:34:07.357198 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_concurrency.lockutils [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:34:07.358082 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:34:07.359186 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_concurrency.lockutils [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:34:07.360080 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO dbcounter [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Registered counter for database nova_cell0 Oct 04 05:34:07.361156 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO dbcounter [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Registered counter for database nova_cell0 Oct 04 05:34:07.364077 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO dbcounter [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Registered counter for database nova_cell1 Oct 04 05:34:07.365662 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO dbcounter [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Registered counter for database nova_cell1 Oct 04 05:34:07.371893 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_db.sqlalchemy.engines [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.373514 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_db.sqlalchemy.engines [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.375615 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_db.sqlalchemy.engines [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.377825 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_db.sqlalchemy.engines [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.378362 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writer thread running {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.382422 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writer thread running {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.385426 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writer thread running {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.516428 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writer thread running {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.526157 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO dbcounter [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Registered counter for database nova_cell0 Oct 04 05:34:07.529628 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO dbcounter [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Registered counter for database nova_cell0 Oct 04 05:34:07.535048 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_db.sqlalchemy.engines [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.539112 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG oslo_db.sqlalchemy.engines [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:34:07.540470 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writer thread running {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.544029 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writer thread running {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:34:07.938667 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: WARNING keystonemiddleware.auth_token [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:34:07.946219 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: WARNING keystonemiddleware.auth_token [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:34:07.988946 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: WARNING keystonemiddleware.auth_token [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:34:07.996241 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: WARNING keystonemiddleware.auth_token [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:34:08.284221 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: WARNING keystonemiddleware.auth_token [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:34:08.290204 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: WARNING keystonemiddleware.auth_token [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:34:08.295468 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d1ae839c0 pid: 112366 (default app) Oct 04 05:34:08.297533 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:34:08.298747 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Oct 04 05:34:08.299166 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Tue Oct 4 05:34:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:34:08.336605 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: WARNING keystonemiddleware.auth_token [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:34:08.342786 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: WARNING keystonemiddleware.auth_token [None req-d4cdd6fe-e6a4-42fb-891b-54ba164d088a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:34:08.348017 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d1ae839c0 pid: 112365 (default app) Oct 04 05:35:31.942669 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:31.943705 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Oct 04 05:35:31.944075 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:31.957023 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_api:SELECT=3 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:31.961617 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_cell0:SELECT=3 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:31.961617 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_cell1:SELECT=3 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:31.961617 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:32.852540 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-2fd30188-2090-4e07-82ae-5db1dc6db6fe admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:32.892795 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-2fd30188-2090-4e07-82ae-5db1dc6db6fe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.941916 Oct 04 05:35:32.893890 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 05:35:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:35:35.502855 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:35.503884 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-0b137773-e37f-4ee9-938d-538e3b71c99f None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 04 05:35:35.504417 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:35.941971 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-c5e722d9-0ee7-4f3d-8b04-1cbe8223305c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:36.050695 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-c5e722d9-0ee7-4f3d-8b04-1cbe8223305c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.540203 Oct 04 05:35:36.051254 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:36.065168 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_api:SELECT=3 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:36.065957 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_cell0:SELECT=3 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:36.069198 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_cell1:SELECT=3 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:36.070243 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:35:36.274059 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b97cc965-d088-4ee1-a3fb-a8ab0bf2b6a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:36.390620 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b97cc965-d088-4ee1-a3fb-a8ab0bf2b6a0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330645 Oct 04 05:35:36.392028 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 05:35:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:35:39.538739 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-c5e722d9-0ee7-4f3d-8b04-1cbe8223305c admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:39.539702 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-c5e722d9-0ee7-4f3d-8b04-1cbe8223305c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 04 05:35:39.540114 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:40.068328 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-cac735bd-8b14-41fc-9871-fe47fd975d67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:40.191400 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-cac735bd-8b14-41fc-9871-fe47fd975d67 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.643497 Oct 04 05:35:40.191979 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:40.204961 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-289d20cf-4863-4376-8abe-5c05bd6f0a13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:40.330954 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-289d20cf-4863-4376-8abe-5c05bd6f0a13 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129976 Oct 04 05:35:40.331742 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 05:35:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:35:42.946050 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-cac735bd-8b14-41fc-9871-fe47fd975d67 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:42.947440 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-cac735bd-8b14-41fc-9871-fe47fd975d67 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 04 05:35:42.947440 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:43.364238 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a60fa84a-99cb-4468-a0a4-cc36ab506059 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:43.458552 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a60fa84a-99cb-4468-a0a4-cc36ab506059 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504695 Oct 04 05:35:43.460737 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:43.474780 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-3816f051-eb6a-4b5c-9c09-13b1e23b5b25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:43.599967 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-3816f051-eb6a-4b5c-9c09-13b1e23b5b25 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129601 Oct 04 05:35:43.600545 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 05:35:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:35:46.170445 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a60fa84a-99cb-4468-a0a4-cc36ab506059 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:46.172576 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a60fa84a-99cb-4468-a0a4-cc36ab506059 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Oct 04 05:35:46.172984 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:46.597781 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-a6f184d5-5a5d-448d-a935-f3901b2feaa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "ram": 2048}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:46.675020 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-a6f184d5-5a5d-448d-a935-f3901b2feaa2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495877 Oct 04 05:35:46.676479 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:46.687669 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-3ea16039-cee4-4852-a560-5c93739abe76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:46.792807 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-3ea16039-cee4-4852-a560-5c93739abe76 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108526 Oct 04 05:35:46.793493 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 05:35:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:35:49.479608 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-a6f184d5-5a5d-448d-a935-f3901b2feaa2 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:49.480770 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-a6f184d5-5a5d-448d-a935-f3901b2feaa2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Oct 04 05:35:49.481192 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:49.884903 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-5a16b345-ad7e-444c-b4aa-1bbd56358a63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:49.965396 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-5a16b345-ad7e-444c-b4aa-1bbd56358a63 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477313 Oct 04 05:35:49.965957 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:49.982177 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-ce69b549-778e-47ed-a511-edec63402e0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:50.066972 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-ce69b549-778e-47ed-a511-edec63402e0b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089669 Oct 04 05:35:50.067483 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 4 05:35:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:35:52.656886 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-5a16b345-ad7e-444c-b4aa-1bbd56358a63 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:52.657890 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-5a16b345-ad7e-444c-b4aa-1bbd56358a63 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Oct 04 05:35:52.658330 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:53.108235 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-76e18f8a-fc05-41c0-8696-95ace3014c4f admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:53.133902 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-76e18f8a-fc05-41c0-8696-95ace3014c4f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469453 Oct 04 05:35:53.134497 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 05:35:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:35:55.695108 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-5a16b345-ad7e-444c-b4aa-1bbd56358a63 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:55.696106 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-5a16b345-ad7e-444c-b4aa-1bbd56358a63 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 04 05:35:55.696507 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:35:56.092568 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-38e890d8-7499-4bd6-acc6-d9ecf98df6bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "id": "1"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:56.179093 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-38e890d8-7499-4bd6-acc6-d9ecf98df6bc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476545 Oct 04 05:35:56.181612 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:56.191730 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-2a65b2cc-e9b9-4175-97e3-0385efd7f4d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:56.276341 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-2a65b2cc-e9b9-4175-97e3-0385efd7f4d6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088413 Oct 04 05:35:56.277284 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 05:35:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:35:58.882936 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-38e890d8-7499-4bd6-acc6-d9ecf98df6bc admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:35:58.883945 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-38e890d8-7499-4bd6-acc6-d9ecf98df6bc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 04 05:35:58.884369 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:35:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:35:59.404779 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-972458a2-b803-4e84-b7f0-0f8131b88a3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "name": "m1.small"}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:59.514565 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-972458a2-b803-4e84-b7f0-0f8131b88a3e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.623915 Oct 04 05:35:59.516050 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:35:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:35:59.528151 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-51ed3683-29cd-488d-9816-378256bee192 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:35:59.615271 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-51ed3683-29cd-488d-9816-378256bee192 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091109 Oct 04 05:35:59.615849 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 05:35:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:36:02.250666 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-972458a2-b803-4e84-b7f0-0f8131b88a3e admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:02.251791 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-972458a2-b803-4e84-b7f0-0f8131b88a3e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Oct 04 05:36:02.252232 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:36:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:02.731461 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-1776fb17-efd1-4b68-bcea-7f5b768d9fdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "name": "m1.medium"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:03.337534 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-1776fb17-efd1-4b68-bcea-7f5b768d9fdd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.075673 Oct 04 05:36:03.339925 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:36:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:03.352543 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-965508be-a8b9-4541-b93c-1966c1cb4531 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:03.357561 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:36:03.451246 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-965508be-a8b9-4541-b93c-1966c1cb4531 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101572 Oct 04 05:36:03.453999 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 05:36:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:36:06.069529 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-1776fb17-efd1-4b68-bcea-7f5b768d9fdd admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:06.071310 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-1776fb17-efd1-4b68-bcea-7f5b768d9fdd admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Oct 04 05:36:06.074198 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:06.505954 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-f8f5894d-d820-4710-a246-f43c4af1931b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:06.572038 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-f8f5894d-d820-4710-a246-f43c4af1931b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.493421 Oct 04 05:36:06.573288 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:36:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:06.586343 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-107e6ec3-f09c-4a49-baf3-fc7a81feae49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:06.591615 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:36:06.672400 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-107e6ec3-f09c-4a49-baf3-fc7a81feae49 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089869 Oct 04 05:36:06.682168 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 05:36:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:36:09.369123 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-f8f5894d-d820-4710-a246-f43c4af1931b admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:09.370190 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-f8f5894d-d820-4710-a246-f43c4af1931b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 04 05:36:09.370752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:36:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:09.807528 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b316b01a-2f72-49db-9aa7-525d100467dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "id": "5", "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:09.879940 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b316b01a-2f72-49db-9aa7-525d100467dd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.502364 Oct 04 05:36:09.880845 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 4 05:36:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:09.897490 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-38d44f58-0964-46ce-a8d6-4f7bb001fd72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:10.009030 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-38d44f58-0964-46ce-a8d6-4f7bb001fd72 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119750 Oct 04 05:36:10.009677 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 4 05:36:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:36:26.251800 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b316b01a-2f72-49db-9aa7-525d100467dd admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:26.252824 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b316b01a-2f72-49db-9aa7-525d100467dd admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 04 05:36:26.253235 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:26.263513 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:36:26.639668 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-023cb44b-ee2a-41a1-8dfd-6c5c728aac62 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:26.658161 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-023cb44b-ee2a-41a1-8dfd-6c5c728aac62 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399102 Oct 04 05:36:26.658702 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 05:36:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:27.964288 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b316b01a-2f72-49db-9aa7-525d100467dd admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:27.965289 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b316b01a-2f72-49db-9aa7-525d100467dd admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 04 05:36:27.965688 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:28.480227 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-14605f24-93c7-444e-b960-93601fdf51d2 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:28.485467 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.wsgi [None req-14605f24-93c7-444e-b960-93601fdf51d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-14605f24-93c7-444e-b960-93601fdf51d2 admin admin] Request method failure captured: Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Accept: application/json Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Accept-Encoding: gzip, deflate Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Connection: keep-alive Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Content-Length: 0 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Host: 10.222.0.26 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Openstack-Api-Version: compute 2.92 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Openstack-System-Scope: None Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: User-Agent: python-novaclient Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Auth-Token: gAAAAABjO8ZbZOQUEVMGcCDPMq9V5FvjziOhSsPxXIBgLzZhPv4mkuTCsSoEtYUbYdjMT2HdLH-SZZVgAnEI4gU1HxktyC1bkcVpeCmtZ8Fc4uzOjC8Gq0loXvsrjZ8dCgoLoUP4HsPE16N31dFqnRebFD0GF35oz1LOeaiCU4u3ES-Ge34J4K0 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Domain-Id: None Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Domain-Name: None Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Identity-Status: Confirmed Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Is-Admin-Project: True Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Domain-Id: default Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Domain-Name: Default Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Name: admin Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Role: admin,member,reader Oct 04 05:36:28.488728 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Roles: admin,member,reader Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c2b6383659b48fcabc56888b6bfb190", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}] Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant: admin Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant-Name: admin Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User: admin Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Domain-Id: default Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Domain-Name: Default Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Id: 4444aa1a4685411fad68fe8a8f2d8f11 Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Name: admin Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: method: > Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: exception: Flavor 42 could not be found. Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: action_args: {'id': '42'} Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:36:28.490486 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:28.491398 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.492570 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-14605f24-93c7-444e-b960-93601fdf51d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:36:28.493616 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-14605f24-93c7-444e-b960-93601fdf51d2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.383145 Oct 04 05:36:28.493616 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 05:36:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 05:36:28.500634 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-5e57f5ce-4a88-42aa-a75d-2578199575f0 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:28.504735 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:36:28.523848 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-5e57f5ce-4a88-42aa-a75d-2578199575f0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027465 Oct 04 05:36:28.524389 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 05:36:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:28.534924 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-15e5ecd1-c039-47dd-b0c7-a30aeb01d0d5 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:28.556663 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-15e5ecd1-c039-47dd-b0c7-a30aeb01d0d5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026200 Oct 04 05:36:28.557196 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 05:36:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:28.567327 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-03572ce7-41f2-48c4-8456-983a0dbc6cb4 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:28.573216 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.wsgi [None req-03572ce7-41f2-48c4-8456-983a0dbc6cb4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-03572ce7-41f2-48c4-8456-983a0dbc6cb4 admin admin] Request method failure captured: Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Accept: application/json Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Accept-Encoding: gzip, deflate Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Connection: keep-alive Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Content-Length: 0 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Host: 10.222.0.26 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Openstack-Api-Version: compute 2.92 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Openstack-System-Scope: None Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: User-Agent: python-novaclient Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Auth-Token: gAAAAABjO8ZbZOQUEVMGcCDPMq9V5FvjziOhSsPxXIBgLzZhPv4mkuTCsSoEtYUbYdjMT2HdLH-SZZVgAnEI4gU1HxktyC1bkcVpeCmtZ8Fc4uzOjC8Gq0loXvsrjZ8dCgoLoUP4HsPE16N31dFqnRebFD0GF35oz1LOeaiCU4u3ES-Ge34J4K0 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Domain-Id: None Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Domain-Name: None Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Identity-Status: Confirmed Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Is-Admin-Project: True Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Domain-Id: default Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Domain-Name: Default Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Name: admin Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Role: admin,member,reader Oct 04 05:36:28.577122 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Roles: admin,member,reader Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c2b6383659b48fcabc56888b6bfb190", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}] Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant: admin Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant-Name: admin Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User: admin Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Domain-Id: default Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Domain-Name: Default Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Id: 4444aa1a4685411fad68fe8a8f2d8f11 Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Name: admin Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: method: > Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: exception: Flavor 42 could not be found. Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: action_args: {'id': '42'} Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:36:28.578778 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:28.579718 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:28.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-03572ce7-41f2-48c4-8456-983a0dbc6cb4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:36:28.582649 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-03572ce7-41f2-48c4-8456-983a0dbc6cb4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014991 Oct 04 05:36:28.582649 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 05:36:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 05:36:29.783703 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-15e5ecd1-c039-47dd-b0c7-a30aeb01d0d5 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:29.784739 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-15e5ecd1-c039-47dd-b0c7-a30aeb01d0d5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 04 05:36:29.785134 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:30.298919 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-6b461bb8-42ae-429a-aef5-2a3ab94eea8d admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:30.303791 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.wsgi [None req-6b461bb8-42ae-429a-aef5-2a3ab94eea8d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-6b461bb8-42ae-429a-aef5-2a3ab94eea8d admin admin] Request method failure captured: Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Accept: application/json Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Accept-Encoding: gzip, deflate Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Connection: keep-alive Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Content-Length: 0 Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Host: 10.222.0.26 Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Openstack-Api-Version: compute 2.92 Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Openstack-System-Scope: None Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: User-Agent: python-novaclient Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Auth-Token: gAAAAABjO8Zd1GZjOSpxAgVVloYWGR4HZPKSDzk9sCZ2YjsviYhvKgvXh5-8hwyO_ct-UtM7NyOzL_dZy0Jg4nXLN1dqBh4b32pDqUSKe-TKE5dEyFLDCo78geHm7iVZSpH7Q8ZhAaPYaoR1eHHFwESdcU5-3rvBSxxRJVUBZkoPEXR0YozIDVw Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Domain-Id: None Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Domain-Name: None Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Identity-Status: Confirmed Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Is-Admin-Project: True Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Domain-Id: default Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Domain-Name: Default Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Name: admin Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Role: admin,member,reader Oct 04 05:36:30.305283 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Roles: admin,member,reader Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c2b6383659b48fcabc56888b6bfb190", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}] Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant: admin Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant-Name: admin Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User: admin Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Domain-Id: default Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Domain-Name: Default Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Id: 4444aa1a4685411fad68fe8a8f2d8f11 Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Name: admin Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: method: > Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: exception: Flavor 84 could not be found. Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: action_args: {'id': '84'} Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:36:30.306852 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:30.307875 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.309459 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-6b461bb8-42ae-429a-aef5-2a3ab94eea8d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:36:30.310757 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-6b461bb8-42ae-429a-aef5-2a3ab94eea8d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385551 Oct 04 05:36:30.310757 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 05:36:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 05:36:30.317151 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-b3e88cd2-edbe-4159-bcce-a77018d34b3e admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:30.331985 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-b3e88cd2-edbe-4159-bcce-a77018d34b3e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018612 Oct 04 05:36:30.332500 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 05:36:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:30.341561 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b5932000-8f6c-41ed-8f4a-930be0635925 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:30.357095 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b5932000-8f6c-41ed-8f4a-930be0635925 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019003 Oct 04 05:36:30.358132 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 05:36:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:30.366971 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-434db884-25df-4854-a289-2082c4a2e9ba admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:30.371811 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.wsgi [None req-434db884-25df-4854-a289-2082c4a2e9ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-434db884-25df-4854-a289-2082c4a2e9ba admin admin] Request method failure captured: Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Accept: application/json Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Accept-Encoding: gzip, deflate Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Connection: keep-alive Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Content-Length: 0 Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Host: 10.222.0.26 Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Openstack-Api-Version: compute 2.92 Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Openstack-System-Scope: None Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: User-Agent: python-novaclient Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Auth-Token: gAAAAABjO8Zd1GZjOSpxAgVVloYWGR4HZPKSDzk9sCZ2YjsviYhvKgvXh5-8hwyO_ct-UtM7NyOzL_dZy0Jg4nXLN1dqBh4b32pDqUSKe-TKE5dEyFLDCo78geHm7iVZSpH7Q8ZhAaPYaoR1eHHFwESdcU5-3rvBSxxRJVUBZkoPEXR0YozIDVw Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Domain-Id: None Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Domain-Name: None Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Identity-Status: Confirmed Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Is-Admin-Project: True Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Domain-Id: default Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Domain-Name: Default Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Name: admin Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Role: admin,member,reader Oct 04 05:36:30.374474 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Roles: admin,member,reader Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c2b6383659b48fcabc56888b6bfb190", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}] Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant: admin Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant-Name: admin Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User: admin Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Domain-Id: default Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Domain-Name: Default Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Id: 4444aa1a4685411fad68fe8a8f2d8f11 Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Name: admin Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: method: > Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: exception: Flavor 84 could not be found. Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: action_args: {'id': '84'} Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:36:30.376072 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:30.377063 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:30.378389 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-434db884-25df-4854-a289-2082c4a2e9ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:36:30.379662 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-434db884-25df-4854-a289-2082c4a2e9ba admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012652 Oct 04 05:36:30.379662 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 4 05:36:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 05:36:31.590855 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b5932000-8f6c-41ed-8f4a-930be0635925 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:31.591918 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b5932000-8f6c-41ed-8f4a-930be0635925 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Oct 04 05:36:31.592323 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:32.111617 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-ee1181c5-c4da-43ae-b647-c8370e97cf80 admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:32.117608 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.wsgi [None req-ee1181c5-c4da-43ae-b647-c8370e97cf80 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-ee1181c5-c4da-43ae-b647-c8370e97cf80 admin admin] Request method failure captured: Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Accept: application/json Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Accept-Encoding: gzip, deflate Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Connection: keep-alive Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Content-Length: 0 Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Host: 10.222.0.26 Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Openstack-Api-Version: compute 2.92 Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Openstack-System-Scope: None Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: User-Agent: python-novaclient Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Auth-Token: gAAAAABjO8ZfNhy1GRVvLOHXcGz4w_6ud7PNFfNCjwItEsScFqr10jXIgQVxNZ4pQI-2Bt97DML8fE5Zwn2kSqNSkNGL8T5WqbEBgYBOkERctybXOmUstkhBNtNQPp9vp0nybpLzGpEDZenTK03xbUpj1H8b-ZDwoTcIV5uOYJRMhfWS7tVCyBs Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Domain-Id: None Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Domain-Name: None Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Identity-Status: Confirmed Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Is-Admin-Project: True Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Domain-Id: default Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Domain-Name: Default Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Project-Name: admin Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Role: admin,member,reader Oct 04 05:36:32.119150 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Roles: admin,member,reader Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c2b6383659b48fcabc56888b6bfb190", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}] Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant: admin Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-Tenant-Name: admin Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User: admin Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Domain-Id: default Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Domain-Name: Default Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Id: 4444aa1a4685411fad68fe8a8f2d8f11 Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: X-User-Name: admin Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: method: > Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: exception: Flavor 451 could not be found. Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: action_args: {'id': '451'} Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:36:32.120752 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:32.121732 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.123080 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-ee1181c5-c4da-43ae-b647-c8370e97cf80 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:36:32.124323 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-ee1181c5-c4da-43ae-b647-c8370e97cf80 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392407 Oct 04 05:36:32.124323 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 05:36:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 05:36:32.130453 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-400df904-3b4c-4412-b2c1-811024b4df15 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:32.145313 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-400df904-3b4c-4412-b2c1-811024b4df15 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018394 Oct 04 05:36:32.145837 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 05:36:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:32.155363 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:32.171168 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019704 Oct 04 05:36:32.171697 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 4 05:36:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:36:32.180881 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b2d61a94-4823-4f21-b2b1-35b7536718ba admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:32.185830 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.wsgi [None req-b2d61a94-4823-4f21-b2b1-35b7536718ba admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b2d61a94-4823-4f21-b2b1-35b7536718ba admin admin] Request method failure captured: Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Accept: application/json Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Accept-Encoding: gzip, deflate Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Connection: keep-alive Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Content-Length: 0 Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Host: 10.222.0.26 Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Openstack-Api-Version: compute 2.92 Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Openstack-System-Scope: None Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: User-Agent: python-novaclient Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Auth-Token: gAAAAABjO8ZfNhy1GRVvLOHXcGz4w_6ud7PNFfNCjwItEsScFqr10jXIgQVxNZ4pQI-2Bt97DML8fE5Zwn2kSqNSkNGL8T5WqbEBgYBOkERctybXOmUstkhBNtNQPp9vp0nybpLzGpEDZenTK03xbUpj1H8b-ZDwoTcIV5uOYJRMhfWS7tVCyBs Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Domain-Id: None Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Domain-Name: None Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Identity-Status: Confirmed Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Is-Admin-Project: True Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Domain-Id: default Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Domain-Name: Default Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Project-Name: admin Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Role: admin,member,reader Oct 04 05:36:32.187387 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Roles: admin,member,reader Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c2b6383659b48fcabc56888b6bfb190", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c2b6383659b48fcabc56888b6bfb190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c2b6383659b48fcabc56888b6bfb190"}]}] Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant: admin Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant-Id: 4c2b6383659b48fcabc56888b6bfb190 Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-Tenant-Name: admin Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User: admin Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Domain-Id: default Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Domain-Name: Default Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Id: 4444aa1a4685411fad68fe8a8f2d8f11 Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: X-User-Name: admin Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: method: > Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: exception: Flavor 451 could not be found. Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: action_args: {'id': '451'} Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:36:32.189011 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:32.190110 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: ERROR nova.api.openstack.wsgi Oct 04 05:36:32.191725 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-b2d61a94-4823-4f21-b2b1-35b7536718ba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:36:32.193001 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-b2d61a94-4823-4f21-b2b1-35b7536718ba admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011385 Oct 04 05:36:32.193001 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 05:36:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 05:36:33.405058 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:33.409167 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 04 05:36:33.409167 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:33.920253 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-310f1a4f-86cc-4357-a484-96d13f234ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:33.991493 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-310f1a4f-86cc-4357-a484-96d13f234ef1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.447370 Oct 04 05:36:33.992034 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 05:36:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:35.222206 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:35.223222 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 04 05:36:35.223618 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:35.737932 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-869aee74-2fed-4566-8902-30a7bd229226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:35.815028 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-869aee74-2fed-4566-8902-30a7bd229226 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.452584 Oct 04 05:36:35.815509 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 05:36:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:37.016515 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:37.017523 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 04 05:36:37.017912 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:37.533967 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-e04cfce2-28d4-442b-b063-ce27187b4a51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:37.593691 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-e04cfce2-28d4-442b-b063-ce27187b4a51 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440859 Oct 04 05:36:37.594285 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 05:36:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:38.798855 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:38.799861 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 04 05:36:38.800258 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:39.318473 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-5f3f58a0-cbbd-4d60-a6b1-92cb64c1e855 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:36:39.391746 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-5f3f58a0-cbbd-4d60-a6b1-92cb64c1e855 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.449451 Oct 04 05:36:39.392230 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 4 05:36:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:36:40.595386 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:40.596382 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 04 05:36:40.596800 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:36:41.109388 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-ef5bc839-9166-46fd-be58-a073bd885f24 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:36:41.129401 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-ef5bc839-9166-46fd-be58-a073bd885f24 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395684 Oct 04 05:36:41.129936 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 4 05:36:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:37:38.088543 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:37:38.089479 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-9ff577d4-41c7-40cc-8e2c-74a0a25f5f1a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Oct 04 05:37:38.089873 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 4 05:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:37:38.100259 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:37:38.470050 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-5804f3e3-73a4-419c-8938-0d9d709a2e04 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:37:38.490921 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-5804f3e3-73a4-419c-8938-0d9d709a2e04 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395103 Oct 04 05:37:38.491452 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 4 05:37:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:37:38.513010 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_api:SELECT=14 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:37:38.516702 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-0abb135a-f47b-4fd2-afda-0035bc015e0f admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:37:38.524112 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-0abb135a-f47b-4fd2-afda-0035bc015e0f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012438 Oct 04 05:37:38.524700 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Oct 4 05:37:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:37:38.536321 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-9c87818a-925b-4a0f-9722-4e3c44660282 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:37:38.544215 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-9c87818a-925b-4a0f-9722-4e3c44660282 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011487 Oct 04 05:37:38.546251 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Oct 4 05:37:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:37:38.556210 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:37:38.564104 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011763 Oct 04 05:37:38.564658 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Oct 4 05:37:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:37:38.576086 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-cf62d1c5-0289-4a8d-adc5-25cc562a4676 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:37:38.583175 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-cf62d1c5-0289-4a8d-adc5-25cc562a4676 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010635 Oct 04 05:37:38.583682 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Oct 4 05:37:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:40:41.493973 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:41.495034 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 04 05:40:41.495430 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:40:41.636172 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_api:SELECT=6 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:40:41.794728 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:41.799457 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:41.799927 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:41.800350 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:41.801058 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:41.801498 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:41.801909 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:41.833356 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-4607383c-42b8-4c96-810d-5f3bd61b7356 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.198354 Oct 04 05:40:41.833906 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 05:40:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:40:42.901248 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:42.902276 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Oct 04 05:40:42.902671 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:40:43.093503 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:43.096943 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:43.097920 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:43.098401 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:43.099114 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:43.099565 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:43.099984 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:43.119413 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-73f4e6d0-a662-48c8-9f26-cd1fa9d74dda admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076451 Oct 04 05:40:43.119980 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 05:40:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:40:54.606871 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:54.607873 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Oct 04 05:40:54.608271 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:40:54.751233 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_cell0:SELECT=4 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:40:54.751953 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_cell1:SELECT=4 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:40:54.752562 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG dbcounter [-] [112366] Writing DB stats nova_api:SELECT=8 {{(pid=112366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:40:54.799616 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:54.803003 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:54.803480 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:54.804538 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:54.805256 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:54.805699 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:54.806112 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:54.831746 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-cf19806b-3807-4ede-9778-f385d5ca6957 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.084802 Oct 04 05:40:54.832235 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 05:40:54 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:40:55.904327 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG nova.api.openstack.wsgi [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] Calling method '>' {{(pid=112365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:55.905324 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: INFO nova.api.openstack.requestlog [None req-a981ebf2-20c9-41fb-8a5c-a65e50cb2c8c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 04 05:40:55.905715 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: [pid: 112365|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 4 05:40:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:40:56.095692 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG nova.api.openstack.wsgi [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Calling method '>' {{(pid=112366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:40:56.099151 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:56.099622 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:56.100042 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:56.100745 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:40:56.101185 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:40:56.101594 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: DEBUG oslo_concurrency.lockutils [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:40:56.124369 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: INFO nova.api.openstack.requestlog [None req-8d7fd06d-a7a9-4b2f-90e7-57343cc80304 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.079937 Oct 04 05:40:56.125208 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: [pid: 112366|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 4 05:40:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:41:52.114981 dv-cinder-849143-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 05:41:52.115664 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: Tue Oct 4 05:41:52 2022 - graceful shutdown triggered... Oct 04 05:41:52.116139 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: Gracefully killing worker 1 (pid: 112365)... Oct 04 05:41:52.116556 dv-cinder-849143-10-iscsi devstack@n-api.service[112366]: Gracefully killing worker 2 (pid: 112366)... Oct 04 05:41:52.241089 dv-cinder-849143-10-iscsi devstack@n-api.service[112365]: DEBUG dbcounter [-] [112365] Writing DB stats nova_api:SELECT=4 {{(pid=112365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:41:53.116672 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: worker 1 buried after 1 seconds Oct 04 05:41:53.117142 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: worker 2 buried after 1 seconds Oct 04 05:41:53.117142 dv-cinder-849143-10-iscsi devstack@n-api.service[112364]: goodbye to uWSGI. Oct 04 05:41:53.118357 dv-cinder-849143-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 05:41:53.118898 dv-cinder-849143-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 05:41:53.121569 dv-cinder-849143-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 05:41:53.130773 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 05:41:53 2022] *** Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: nodename: dv-cinder-849143-10-iscsi Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: machine: x86_64 Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: clock source: unix Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: pcre jit disabled Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: detected number of CPU cores: 4 Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: current working directory: / Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: detected binary path: /usr/bin/uwsgi-core Oct 04 05:41:53.132774 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: your processes number limit is 47680 Oct 04 05:41:53.133721 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: your memory page size is 4096 bytes Oct 04 05:41:53.133721 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: detected max file descriptor number: 2048 Oct 04 05:41:53.133721 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: lock engine: pthread robust mutexes Oct 04 05:41:53.133721 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: thunder lock: enabled Oct 04 05:41:53.133721 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 05:41:53.133721 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 05:41:53.172940 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: Python main interpreter initialized at 0x55a2d52569c0 Oct 04 05:41:53.172940 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: python threads support enabled Oct 04 05:41:53.172940 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: your server socket listen backlog is limited to 100 connections Oct 04 05:41:53.172940 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: your mercy for graceful operations on workers is 90 seconds Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: *** Operational MODE: preforking *** Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: *** uWSGI is running in multiple interpreter mode *** Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: spawned uWSGI master process (pid: 127379) Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: spawned uWSGI worker 1 (pid: 127392, cores: 1) Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: spawned uWSGI worker 2 (pid: 127393, cores: 1) Oct 04 05:41:53.183816 dv-cinder-849143-10-iscsi devstack@n-api.service[127379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 05:41:53.173835 dv-cinder-849143-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 05:41:53.845885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 05:41:53.852306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 05:41:55.007531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:41:55.007531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: from cryptography.utils import int_from_bytes Oct 04 05:41:55.008174 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:41:55.008174 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: from cryptography.utils import int_from_bytes Oct 04 05:41:55.009748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:41:55.009748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: from cryptography.utils import int_from_bytes Oct 04 05:41:55.010224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 05:41:55.010224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: from cryptography.utils import int_from_bytes Oct 04 05:41:57.450789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 05:41:57.451333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 05:41:57.451582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 05:41:57.452033 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 05:41:57.452286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 05:41:57.452625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.452944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.453269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.453608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.453937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.454288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.454983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.454983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.455246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.455512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.455831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.456328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-10-iscsi {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.456698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.456942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.457264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.457380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 05:41:57.457765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.457853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 05:41:57.457932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.458199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 05:41:57.458324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.458636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.458761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 05:41:57.458852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 05:41:57.459034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.460576 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.460738 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.460850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.460946 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461319 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.461986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462289 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-10-iscsi {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-10-iscsi {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.462930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.463068 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.463261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.463460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.463673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.463786 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464662 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.464981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.465081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.465301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.465483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.465597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.465799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.465926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.466107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.466275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.466452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.466620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.466800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.466981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.467117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.467243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.467430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.467558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.467750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.467854 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468153 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.468963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.469116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-10-iscsi {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.469282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.469418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.469598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.469697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.469921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.470036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.470269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.470440 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.479698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.479698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.479919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.479919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480715 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.480959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481032 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481286 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481535 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481774 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.481999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482069 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482660 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482738 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.482977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483398 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483556 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483634 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483720 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483880 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.483953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484268 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484746 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.484983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485085 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485159 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485315 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.485948 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486098 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486689 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.486954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487361 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.487905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488167 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.488965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489319 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.489993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.490104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.490251 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.490390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.490526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.490662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.491281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.491417 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.491544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.491670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.491798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.491942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492085 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.492906 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493742 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.493996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494552 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494811 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.494937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495076 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495202 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495326 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495792 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.495942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.496876 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497301 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.497885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.498003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.498122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.503850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.504637 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.504819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.504965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.505100 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.505240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.505379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.505525 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.505778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.505996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.506129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.506368 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.507155 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.507302 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.507435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.507565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.507700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.507829 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.507957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.508099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.508263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.508393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.508527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.508655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.508784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.508991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.509147 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.509277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.509419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.509419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.509760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.509897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.510024 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.510228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.510391 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.510534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.510674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.510833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.510963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.510963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.511303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.511440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.511584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.511725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.511725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.511974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 05:41:57.512110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.512320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.512460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.512600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.512728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.512856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.513009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.513300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.513579 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.513721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.513862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.513990 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514567 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.514971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.515145 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.515318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.515465 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.515604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.515741 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.515741 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.516019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.516313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.516463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.516600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.516736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.516865 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517501 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.517900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518037 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.518991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.519125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.519260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.519417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.519565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.519779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.519911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520543 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520653 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.520989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521739 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.521927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.522036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.522198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.526721 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.526851 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.527976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.528122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.528358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.528572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.528810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.528966 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.529129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.529280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.529566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.529727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.529982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.529982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.530997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.531445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.531608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.531774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.531922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.532953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.533192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.533192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.533859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.534048 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.538231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.538474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.538651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.538834 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539169 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539644 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.539920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540007 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540271 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540719 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.540989 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541429 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541864 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.541963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542049 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542248 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542332 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542529 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542623 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.542884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.543888 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544168 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544440 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544711 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.544840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545173 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545841 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.545977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546615 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.546968 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.547949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548169 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.548934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549138 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549490 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.549981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550413 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550509 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550687 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550867 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.550960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551146 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551453 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551561 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.551915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552084 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552360 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552459 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.552915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.553001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.553089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.553182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.553816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.553931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554781 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.554873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555005 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555219 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555397 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.555995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.556929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557772 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.557943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558345 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558858 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.558943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.559074 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.559162 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.559257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.559457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.559783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.559900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560030 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.560938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561397 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561481 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561741 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561836 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.561922 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562108 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562223 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562531 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562618 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562796 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562881 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.562982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563612 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.563951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564433 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.564997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565174 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565531 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565708 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565845 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.565975 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566395 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566832 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.566968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567478 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567719 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.567949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568467 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568733 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.568921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.569602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.569732 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.569881 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.569987 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.570081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.572731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.572879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.572970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573056 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573140 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573322 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573789 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.573882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574275 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574746 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.574976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575325 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.575953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576399 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576485 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576759 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.576935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577019 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577260 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.577958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578126 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578249 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.578934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579154 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.579891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580121 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580453 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580688 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.580963 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.581932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582199 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582455 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.582992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583085 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583177 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.583943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584277 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.584962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585266 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585455 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.585982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586266 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.586967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587416 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587634 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587730 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.587964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.588064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.588273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.588368 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.588580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.588708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589791 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.589892 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.590110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.590299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.590470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.590591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.590789 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.590884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.591097 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.591247 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.591414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.591516 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.591725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.591826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592146 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592344 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.592964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.593180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.593271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.593407 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.593565 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.593717 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.593872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.594041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.594200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.594387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.594530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.594708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.594853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595147 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.595983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.596083 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.596302 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.596399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.596657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.596771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.596991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.597084 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.597312 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.597411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.597625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.597727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.597942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.598048 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.598285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.598380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.603995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604121 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604646 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604734 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.604858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.605904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.606968 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.607939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608050 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608145 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608145 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.608938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609123 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609352 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.609922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610406 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.610992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.611928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612513 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.612943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.613947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.617665 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.618634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.626790 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.626947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627123 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627397 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627537 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.627916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628717 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.628951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629133 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629456 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629644 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629837 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.629924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630069 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630653 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.630918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.631010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.631010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.631222 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.631304 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.631438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632047 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632394 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632575 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632746 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.632969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633329 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633753 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.633942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634030 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634324 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.634976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635071 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635335 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635429 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635596 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635682 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635773 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.635959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636510 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636648 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.636806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637662 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.637927 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638251 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.638965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639105 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639382 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.639912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640137 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640497 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640683 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.640949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641091 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.641999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.642906 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643518 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643838 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.643931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644019 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644474 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.644975 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645061 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645326 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645611 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.645946 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.646040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.646155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.649709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.649850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.649954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650532 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.650921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651102 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651400 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651681 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.651933 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652105 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652276 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652638 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.652918 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653687 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.653876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654162 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.654938 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655406 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655681 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.655988 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656151 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656417 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656504 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.656863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657229 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657771 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.657962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658048 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658254 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.658969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659147 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.659907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660097 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660229 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.660910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.661014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.661234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.661339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.661559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.661843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.661939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.662214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.662324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.662529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.663160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.663366 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.663523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.663694 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.663812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.663975 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.664114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.664303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.664430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.664618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.664767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.664927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.665040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.665234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.665335 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.665549 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.665649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.665864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.666102 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.666272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.666466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.666561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.666786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.666895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.667114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.667208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.667443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.667574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.667761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.667866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668070 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.668997 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.669107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.669304 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.669407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.669618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.669721 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.669923 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.670016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.670253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673139 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673139 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673466 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.673915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674109 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674325 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.674956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675639 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675734 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.675917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676738 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.676934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.677943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.678038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.678153 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.678285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.678882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679216 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.679980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.680218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.680313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.680537 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.680633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.680859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.681111 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.681222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.681447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.681558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.681770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.681866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.682089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.682228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.682432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.682531 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.682749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.682851 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.683057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.683168 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.683363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.683457 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.683687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.683781 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684745 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.684942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685075 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.685985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.686219 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.686369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.686537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.686683 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.686850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.686951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.687162 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.687261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.687473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.687582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.687784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.687929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.688371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.688479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.688689 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.688784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689660 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.689982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.690088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.690331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.690439 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.690646 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.690748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.690959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.691066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.691272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.691420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.691642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.691757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.691904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692236 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.692957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.693232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.693337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.693565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.693666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.693914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.694013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.694248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.694348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.694562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.694656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.694870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695501 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.695901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.696114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.696209 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.696418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.696546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.696731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.696847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.697957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.698079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.698293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.698390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.698600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.701436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.701576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.701678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.701768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.701861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.701949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702044 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702349 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702892 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.702977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.703979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704345 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704803 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704888 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.704974 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705816 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.705909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.706945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.707165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.707286 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.707478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.707636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.707871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.708932 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.709143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.709250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.709458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.709571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.709796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.709898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.710110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.710305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.710449 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.710543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.710760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.710866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.711079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.711180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.711394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.711488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.711698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.712592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.712592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.712858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.712972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713083 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713319 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713664 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.713903 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.714946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715065 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.715828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716335 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716654 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.716984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.717110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.717312 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.717443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.717578 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 05:41:57.717702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.717941 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.718322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.718647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.718970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.719317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.719645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.719965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.720281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.720589 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 05:41:57.720834 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 05:41:57.779401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO dbcounter [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Registered counter for database nova_api Oct 04 05:41:57.782622 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO dbcounter [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Registered counter for database nova_api Oct 04 05:41:57.801708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_db.sqlalchemy.engines [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:57.804876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_db.sqlalchemy.engines [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:57.810694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writer thread running {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:57.811435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writer thread running {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:57.867373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.context [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57801ef0-8805-4133-b9bc-7641eae48053(cell1) {{(pid=127392) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 05:41:57.867951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.context [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57801ef0-8805-4133-b9bc-7641eae48053(cell1) {{(pid=127393) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 05:41:57.871436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:41:57.871952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:41:57.872064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:41:57.872459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:41:57.873592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:41:57.874059 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:41:57.874372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:41:57.874823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:41:57.874921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:41:57.875285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:41:57.876848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:41:57.877270 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:41:57.878885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO dbcounter [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Registered counter for database nova_cell0 Oct 04 05:41:57.879338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO dbcounter [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Registered counter for database nova_cell0 Oct 04 05:41:57.883143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO dbcounter [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Registered counter for database nova_cell1 Oct 04 05:41:57.883720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO dbcounter [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Registered counter for database nova_cell1 Oct 04 05:41:57.892538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_db.sqlalchemy.engines [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:57.893160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_db.sqlalchemy.engines [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:57.894415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_db.sqlalchemy.engines [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:57.897622 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_db.sqlalchemy.engines [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:57.898642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writer thread running {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:57.901837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writer thread running {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:57.903218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writer thread running {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:58.042836 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writer thread running {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:58.052205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO dbcounter [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Registered counter for database nova_cell0 Oct 04 05:41:58.052387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO dbcounter [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Registered counter for database nova_cell0 Oct 04 05:41:58.061360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_db.sqlalchemy.engines [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:58.063950 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_db.sqlalchemy.engines [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 05:41:58.066623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writer thread running {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:58.068943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writer thread running {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 05:41:58.386848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: WARNING keystonemiddleware.auth_token [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:41:58.394123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: WARNING keystonemiddleware.auth_token [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:41:58.394373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: WARNING keystonemiddleware.auth_token [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:41:58.403014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: WARNING keystonemiddleware.auth_token [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:41:58.739425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: WARNING keystonemiddleware.auth_token [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:41:58.745510 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: WARNING keystonemiddleware.auth_token [None req-98158fb1-72cd-46dc-8c29-074b3138d999 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:41:58.750867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2d52569c0 pid: 127392 (default app) Oct 04 05:41:58.754204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: WARNING keystonemiddleware.auth_token [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 05:41:58.760722 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: WARNING keystonemiddleware.auth_token [None req-9f8f70eb-3c63-4011-854a-d86cb944d1fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 05:41:58.765979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2d52569c0 pid: 127393 (default app) Oct 04 05:42:40.305604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-03f0568d-1305-4031-a8f5-0d530a9d7d03 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04875b20d0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:40.334249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:40.335439 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:40.336891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:40.337835 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:41.831543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-03f0568d-1305-4031-a8f5-0d530a9d7d03 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e8ebc277-3455-4c15-a0d2-ba30fc61ca0b" status: 200 len: 350 microversion: 2.1 time: 1.812391 Oct 04 05:42:41.832475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 1/1] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:42:40 2022] GET /compute/v2.1/os-volumes/e8ebc277-3455-4c15-a0d2-ba30fc61ca0b => generated 350 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:44.560039 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-073e5b96-fec3-4218-9f76-28a261c6f171 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04875b20d0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:44.599896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:44.599896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:44.599896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:44.599896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:42:45.541625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-073e5b96-fec3-4218-9f76-28a261c6f171 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1916e26f-426f-494c-a262-9a5939ab5880" status: 200 len: 350 microversion: 2.1 time: 1.560714 Oct 04 05:42:45.548159 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:42:43 2022] GET /compute/v2.1/os-volumes/1916e26f-426f-494c-a262-9a5939ab5880 => generated 350 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:47.989310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6dc6bb3b-e241-4ac1-aff4-1103b7682b31 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04873e7280>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:48.069433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6dc6bb3b-e241-4ac1-aff4-1103b7682b31 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a2342ca5-efee-49aa-877a-24ef74e48828" status: 200 len: 351 microversion: 2.1 time: 0.084598 Oct 04 05:42:48.084712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:42:47 2022] GET /compute/v2.1/os-volumes/a2342ca5-efee-49aa-877a-24ef74e48828 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:48.086546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1a35bd4a-53be-4a88-96c4-b50025c9bc46 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04873ea1f0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:48.304548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1a35bd4a-53be-4a88-96c4-b50025c9bc46 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.223090 Oct 04 05:42:48.313608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 4 05:42:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:42:48.320540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a1c6a6e4-fc73-4fa0-a74c-cb6b44d3b199 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04873e7af0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:48.443344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a1c6a6e4-fc73-4fa0-a74c-cb6b44d3b199 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127005 Oct 04 05:42:48.458244 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 4 05:42:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:48.459040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-81d536f8-cea7-4749-8e56-975b4018c1c0 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04873ead30>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:48.558601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-81d536f8-cea7-4749-8e56-975b4018c1c0 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.103727 Oct 04 05:42:48.568297 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 4 05:42:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:42:48.572751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5e502ca4-4fe9-405e-b036-02ac0e12278d tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04873e74c0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:49.061151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5e502ca4-4fe9-405e-b036-02ac0e12278d tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.492085 Oct 04 05:42:49.062099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 4 05:42:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:49.081053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5aacdf86-265e-48c4-b3e4-1d2edec2d94f tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f0487409700>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:49.355141 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5aacdf86-265e-48c4-b3e4-1d2edec2d94f tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.281085 Oct 04 05:42:49.367578 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 4 05:42:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:49.383308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8ac6e9d7-e965-4bca-8d58-8c4e1d9a3f39 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f0487409820>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:49.631668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8ac6e9d7-e965-4bca-8d58-8c4e1d9a3f39 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.262718 Oct 04 05:42:49.641978 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 4 05:42:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:42:49.647157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cc36507a-bf5e-4f89-8cd1-567cffc2ac69 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f04873ea790>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:49.915438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cc36507a-bf5e-4f89-8cd1-567cffc2ac69 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.272180 Oct 04 05:42:49.925734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 6/10] 10.222.0.26 () {58 vars in 1188 bytes} [Tue Oct 4 05:42:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:50.186587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6eebc585-e590-4324-b6e8-c22b1a01c811 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: .version_select at 0x7f0487407670>, body: {"keypair": {"name": "tempest-keypair-1822461495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLSqy3/Wfv15CbyexrCMUyC03QfMzwk07MGSNUcCBWzamxjKss+EMTRRovl1V2lbW9NoIDamd0YAOaYkXHKl2fVk1cvdsMrzxB7fuAxjuVJywEXsiW2EuxcRkrZ3I9cew=="}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:42:50.308657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-6eebc585-e590-4324-b6e8-c22b1a01c811 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:42:50.331494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-6eebc585-e590-4324-b6e8-c22b1a01c811 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:42:50.538250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6eebc585-e590-4324-b6e8-c22b1a01c811 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.278996 Oct 04 05:42:50.542190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 5/11] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:42:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:42:50.547561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f2f88b17-af8c-4e6b-a69a-8cd1e27a53d0 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] Calling method '.version_select at 0x7f048736b160>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:50.645526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e05d2cb9-c1cb-4d77-b689-012901043da4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'create', calling method: .version_select at 0x7f0487d57a60>, body: {"keypair": {"name": "tempest-keypair-19348087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjwbvagWjunvv4CVT6v6CerPvadpVrllUp2M+Qy9DS+6jRWkBpK45qCCtlAW5IbC8zQZT7c5H+eFteUt0SYlJMojtSpj7PqnpKEGUrerb5b7Ue6JarOdwBL9/c29NWnFQ=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:42:50.703293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f2f88b17-af8c-4e6b-a69a-8cd1e27a53d0 tempest-VolumesTestJSON-856606424 tempest-VolumesTestJSON-856606424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161874 Oct 04 05:42:50.703960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 4 05:42:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:42:50.785416 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-e05d2cb9-c1cb-4d77-b689-012901043da4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for project 636e6b38bf1d4736a38728488881e9d2. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:42:50.805652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-e05d2cb9-c1cb-4d77-b689-012901043da4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for user 6f1635c9c6cf4fb092c0f03a02e36174 and project 636e6b38bf1d4736a38728488881e9d2. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:42:50.989504 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e05d2cb9-c1cb-4d77-b689-012901043da4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 1.070220 Oct 04 05:42:50.998047 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 7/13] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 4 05:42:49 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1080 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 05:42:56.214490 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1459413549", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "networks": [{"uuid": "46ff3f68-ce31-4d95-a2fd-eff768762bb7"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:42:56.369889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] validate_networks() for [('46ff3f68-ce31-4d95-a2fd-eff768762bb7', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:42:56.981569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6249966d-25c2-46b6-a6da-5d8635ded4f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: .version_select at 0x7f048736c0d0>, body: {"keypair": {"name": "tempest-keypair-1097252279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUAfFoJuvww8w9mBbyx71bOtpb8wcN67rASueurS9cbotM16mUzRB3+fJAgs5sPkQdNmxu0uiMU0T/j5/+trcAN+a8CrCVA9Bptjq92hYHABdlguZZeyEYoPxyRrhw3Sg=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:42:57.017415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-6249966d-25c2-46b6-a6da-5d8635ded4f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for project 7efd5ee13f094656992497528d761f2c. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:42:57.029637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-6249966d-25c2-46b6-a6da-5d8635ded4f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for user 537981b1b3a14cb4b10f336ef0362358 and project 7efd5ee13f094656992497528d761f2c. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:42:57.194668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6249966d-25c2-46b6-a6da-5d8635ded4f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.082723 Oct 04 05:42:57.195611 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 8/14] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:42:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:42:57.205771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-846504383", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c58c152-65b4-475d-9100-474584bb25cf"}], "security_groups": [{"name": "tempest-securitygroup--62236074"}], "key_name": "tempest-keypair-1822461495", "user_data": "}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:42:57.776302 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:42:57.776914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:42:57.777401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:42:57.777819 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:42:57.778406 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:42:57.803135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] validate_networks() for [('2c58c152-65b4-475d-9100-474584bb25cf', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:42:57.810089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:42:57.810815 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:42:57.812087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:42:57.813620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:42:57.814529 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:42:57.815108 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:42:57.848271 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Getting quotas for project b427232479e14a6fa576f4461032f12b. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:42:57.854009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Getting quotas for user 9d1d5de04c894a2ab780bcdee15f5c5b and project b427232479e14a6fa576f4461032f12b. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:42:57.869208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:42:57.874203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:42:58.060539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d8b045b9-e2d4-4562-9178-1abe6c8d10d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836941 Oct 04 05:42:58.061554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 7/15] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:42:58.122115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1996258994", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cfb3053-30b6-4a8c-ab04-88f5f64c550f"}], "security_groups": [{"name": "tempest-securitygroup--146609419"}], "key_name": "tempest-keypair-19348087", "user_data": "}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:42:58.576882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] validate_networks() for [('6cfb3053-30b6-4a8c-ab04-88f5f64c550f', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:42:59.603979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:42:59.604546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:42:59.604865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:42:59.605437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:42:59.606116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:42:59.625723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:42:59.626246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:42:59.626687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:42:59.627418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:42:59.627869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:42:59.628321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:42:59.664155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for project 636e6b38bf1d4736a38728488881e9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:42:59.672321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for user 6f1635c9c6cf4fb092c0f03a02e36174 and project 636e6b38bf1d4736a38728488881e9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:42:59.686282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:42:59.689163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:42:59.888319 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-054aaef7-e1d7-4899-a480-a8ee3a58d5d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.825250 Oct 04 05:42:59.891016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 8/16] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 4 05:42:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 05:42:59.900793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b3ec703f-fcd5-4f15-b053-632ef6eb198b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:42:59.927613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b3ec703f-fcd5-4f15-b053-632ef6eb198b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:00.134182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3ec703f-fcd5-4f15-b053-632ef6eb198b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:00.182345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b3ec703f-fcd5-4f15-b053-632ef6eb198b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1215 microversion: 2.1 time: 0.289362 Oct 04 05:43:00.184255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:42:59 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:00.205426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-34441868-651c-495d-8ff6-d612c4d99957 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:00.207435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-34441868-651c-495d-8ff6-d612c4d99957 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:00.233898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:43:00.234475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:43:00.235572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:43:00.236459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:43:00.236553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:43:00.263106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:00.263588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:00.279355 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:00.282606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:00.287382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:00.289329 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:00.372599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:43:00.377402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:43:00.380454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-34441868-651c-495d-8ff6-d612c4d99957 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:00.407590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-34441868-651c-495d-8ff6-d612c4d99957 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:00.411663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-34441868-651c-495d-8ff6-d612c4d99957 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:00.418633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-34441868-651c-495d-8ff6-d612c4d99957 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1280 microversion: 2.20 time: 0.229520 Oct 04 05:43:00.419242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 10/18] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:00 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:00.437170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:43:00.448265 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:43:00.676550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-18389100-87e9-4f20-8a45-b847e000e4ca tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.479686 Oct 04 05:43:00.679662 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 9/19] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:42:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 3483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:43:00.694315 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9683be80-7cbb-4228-abc3-72a64678a758 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:00.695206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9683be80-7cbb-4228-abc3-72a64678a758 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:00.825180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9683be80-7cbb-4228-abc3-72a64678a758 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:00.832807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9683be80-7cbb-4228-abc3-72a64678a758 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1241 microversion: 2.1 time: 0.145752 Oct 04 05:43:00.854121 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:00 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:01.207931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:01.208570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:01.234566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:01.235545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:01.237707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:01.240715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:01.243545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:01.244225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:01.444844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-11fcef67-ed75-4de9-9051-5b125ce40e93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:01.445641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-11fcef67-ed75-4de9-9051-5b125ce40e93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:01.670396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-11fcef67-ed75-4de9-9051-5b125ce40e93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:01.681308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-11fcef67-ed75-4de9-9051-5b125ce40e93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:01.683180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-11fcef67-ed75-4de9-9051-5b125ce40e93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:01.684652 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-11fcef67-ed75-4de9-9051-5b125ce40e93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1280 microversion: 2.20 time: 0.244017 Oct 04 05:43:01.698176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 12/21] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:01 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:01.717550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:01.737096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-35ed0fe4-f6b2-4a5b-a5e0-37183ff5c1d2 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1211 microversion: 2.1 time: 0.533861 Oct 04 05:43:01.738624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 10/22] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:01 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1211 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:01.859461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fb02805c-da02-47a6-8fbd-1e9fc08389ef tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:01.860496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fb02805c-da02-47a6-8fbd-1e9fc08389ef tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:01.969234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fb02805c-da02-47a6-8fbd-1e9fc08389ef tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:01.978950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fb02805c-da02-47a6-8fbd-1e9fc08389ef tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1241 microversion: 2.1 time: 0.124158 Oct 04 05:43:01.981477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 13/23] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:01 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:02.720588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:02.720588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:02.720588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:02.721285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:02.721883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:02.728791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-445636903", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c03165e1-beb9-4a5b-abe8-8381d5e7772e"}], "security_groups": [{"name": "tempest-securitygroup--1339997058"}], "key_name": "tempest-keypair-1097252279", "user_data": "}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:02.735729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:02.740581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:02.740581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:02.843996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:02.853331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:02.855121 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:02.856599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e89d0c89-b28a-4379-890d-4998cc54dcce tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1284 microversion: 2.20 time: 0.148759 Oct 04 05:43:02.859136 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 11/24] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:02 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:02.864253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:02.864871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:02.870755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:02.871244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:02.871687 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:02.872382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:02.872845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:02.873276 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:02.911201 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] validate_networks() for [('c03165e1-beb9-4a5b-abe8-8381d5e7772e', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:43:02.961064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:02.969625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-57d1d881-3161-4a6a-98cc-1b6408e0a506 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1267 microversion: 2.1 time: 0.109631 Oct 04 05:43:02.970471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:02 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:03.004361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:03.005178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:03.011970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:03.012964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:03.013607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:03.014478 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:03.015075 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:03.015645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:03.095157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:03.105642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-71e036ca-aeb2-4c14-9b64-d76c4635c9d0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1245 microversion: 2.1 time: 0.105231 Oct 04 05:43:03.106570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:02 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:03.748627 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:43:03.749254 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:43:03.750274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:43:03.751301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:43:03.752056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:43:03.769990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:03.769990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:03.769990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:03.769990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:03.770633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:03.771332 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:03.824690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for project 7efd5ee13f094656992497528d761f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:43:03.846371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for user 537981b1b3a14cb4b10f336ef0362358 and project 7efd5ee13f094656992497528d761f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:43:03.865192 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:43:03.868555 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:43:03.889289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:03.894644 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:03.921451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:03.923778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:03.925762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:03.927876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:03.930691 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:03.931894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:04.072571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7de878bb-7801-4bd5-af36-5cc776f6e2b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.349046 Oct 04 05:43:04.073792 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 14/27] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:43:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:43:04.078962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:04.079763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:04.087063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:04.092996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:04.092996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:04.092996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:04.092996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:04.093396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:04.148579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:04.157898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:04.163394 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:04.164550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a19757d5-4ee8-4ca2-b9cf-6f211ccc93e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1276 microversion: 2.20 time: 0.281711 Oct 04 05:43:04.169993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 14/28] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:03 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:04.177050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fd88f3a9-f1d2-42cd-b88a-cb0c6cdc3ff2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:04.177659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fd88f3a9-f1d2-42cd-b88a-cb0c6cdc3ff2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:04.276766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fd88f3a9-f1d2-42cd-b88a-cb0c6cdc3ff2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:04.283458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:04.296651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fd88f3a9-f1d2-42cd-b88a-cb0c6cdc3ff2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1237 microversion: 2.1 time: 0.125427 Oct 04 05:43:04.297024 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6e0d5dab-ced2-4333-b29c-58b482b3d56e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1273 microversion: 2.1 time: 0.221963 Oct 04 05:43:04.298096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:04 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:04.305149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:04.305149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:04.316309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:04 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1237 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:04.323489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:04.324094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:04.324641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:04.325462 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:04.325984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:04.326601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:04.423272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:04.433329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8357afbe-ffd4-40c3-b04e-4db9d1f69c58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1293 microversion: 2.1 time: 0.134098 Oct 04 05:43:04.447044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:04 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1293 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:05.203149 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:05.204201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:05.221291 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:05.221837 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:05.227178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:05.228237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:05.228723 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:05.229159 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:05.325055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:05.325660 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:05.340702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:05.341212 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:05.342731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:05.343496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:05.343951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:05.344381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:05.631120 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:05.654107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:05.659314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:05.664469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c39e5a35-91ea-44ea-9da1-408a2c8fedc0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1332 microversion: 2.20 time: 0.467790 Oct 04 05:43:05.665061 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 16/32] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:05 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1332 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:05.675538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b30ba4c8-9013-4040-9636-1b54c872d3cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:05.676149 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b30ba4c8-9013-4040-9636-1b54c872d3cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:05.941667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b30ba4c8-9013-4040-9636-1b54c872d3cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:05.951717 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b30ba4c8-9013-4040-9636-1b54c872d3cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1237 microversion: 2.1 time: 0.282328 Oct 04 05:43:05.953532 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:05 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1237 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:05.963314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:05.963999 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:05.980771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:05.981153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:05.983995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:05.984746 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:05.985210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:05.985636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:06.264517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:06.276112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1496a2a1-71c8-4afb-99a2-896a99a04e56 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.955747 Oct 04 05:43:06.286211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:05 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:06.327674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:06.344657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b5cdc142-7117-472a-a4d2-4172a22f1137 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1299 microversion: 2.1 time: 0.390027 Oct 04 05:43:06.345235 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 18/35] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:05 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1299 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:06.697036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:06.697963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:06.712050 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:06.713094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:06.714191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:06.715142 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:06.715598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:06.722019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:07.116783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:07.116783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:07.120062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:07.120062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-dac296b1-99d7-4eb6-a726-837fc1b426b4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1338 microversion: 2.20 time: 0.272809 Oct 04 05:43:07.120062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 18/36] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:06 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1338 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:07.121747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:07.121747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:07.121747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:07.121747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:07.121997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:07.121997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:07.121997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:07.121997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:07.139257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:07.155379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f98e8761-cb54-47b5-98ff-bc13bec62c27 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1233 microversion: 2.1 time: 0.177213 Oct 04 05:43:07.156555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 19/37] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:06 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1233 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:07.317512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:07.318214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:07.327497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:07.328000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:07.328445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:07.329161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:07.329623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:07.330062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:07.389750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:07.389750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:07.389750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:07.389750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:07.390736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:07.390736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:07.390736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:07.390736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:08.060659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:08.069075 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7fc8417d-6ced-4efc-9d2b-ffaebce099f7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.757519 Oct 04 05:43:08.087333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:07 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:08.149257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:08.152162 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:08.172592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:08.173134 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:08.173565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:08.174365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:08.174827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:08.175259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:08.342099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:08.350443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-44bbb28e-7252-4830-82bb-3e94e1ed0215 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.980807 Oct 04 05:43:08.354947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:07 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:08.366555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:08.367526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:08.379315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:08.380054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:08.380678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:08.381589 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:08.382264 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:08.382916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:08.477505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:08.486092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:08.494430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:08.494430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2f884ebb-b1ed-46bd-9428-0b7a2c80c845 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1338 microversion: 2.20 time: 0.352810 Oct 04 05:43:08.494430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:08 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1338 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:08.580166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:08.596637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ba56c976-9120-4947-a383-fc48f5c9cffe tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1289 microversion: 2.1 time: 0.240271 Oct 04 05:43:08.602606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:08 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1289 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:09.099628 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:09.101775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:09.117276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:09.117623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:09.122468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:09.127991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:09.131203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:09.132947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:09.378769 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:09.379395 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:09.409437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:09.429261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:09.430765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:09.435609 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:09.438131 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:09.441463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:09.862479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:09.873706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-73a52b28-2a47-4452-ab54-8c1ab2f0c210 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.781094 Oct 04 05:43:09.876600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:09 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:09.901249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:09.902523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:09.910892 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:09.919159 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:09.924633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:09.924982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:09.925822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:09.926202 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:09.926640 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.260364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:10.272919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:10.280067 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:10.281312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d1f2c5d5-d761-4da1-9f5b-b12a8cedc928 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.403595 Oct 04 05:43:10.286928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:09 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:10.344759 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:10.394315 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226a13ae-7a83-488a-9e42-7f524be2114c", "tag": "dc0907bd-05c2-480f-a9cd-803e9153eda6"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:10.409859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.410594 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.411116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.413693 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:10.425523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a6930999-1c10-40c0-b524-ab1dd7db9826 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 1.050097 Oct 04 05:43:10.427350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 22/44] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:09 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:10.433725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:10.434681 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:10.445934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.450421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.450421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.450421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.450421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.450767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.459802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Creating event network-changed:dc0907bd-05c2-480f-a9cd-803e9153eda6 for instance 226a13ae-7a83-488a-9e42-7f524be2114c on hv-cinder-84914 Oct 04 05:43:10.460410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 05:43:10.461145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1efe8b7c-d03b-4c53-acfd-a6a136dc37a3 req-24947bb5-f4c5-4768-a810-d917a9d25bb7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 05:43:10.462431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.463190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.463914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.465054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.465782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.466456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.510477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.compute.rpcapi [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 05:43:10.510845 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] Releasing lock "compute-rpcapi-router" {{(pid=127392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 05:43:10.564051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a7f3f07d-26a8-4f20-9206-8fd824dea0fb None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275299 Oct 04 05:43:10.565298 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 23/45] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:10.682227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:10.693721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fcc297eb-df7a-49af-92ca-61689f9bcd9c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1295 microversion: 2.1 time: 0.265121 Oct 04 05:43:10.698417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 23/46] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:10 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1295 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:10.905547 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:10.906799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:10.920346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.925115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.925115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.925115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.941519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.942199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.946762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-230c710e-3e69-485d-a732-8809d433b96d req-7e1f8c4a-5cf2-4f11-9512-f53a32f6413d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71aa646b-022b-46dc-a362-fe7d63d90f5a", "tag": "91086c81-b058-42da-8552-c21268a1fe5f"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:10.961753 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-230c710e-3e69-485d-a732-8809d433b96d req-7e1f8c4a-5cf2-4f11-9512-f53a32f6413d service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:10.962282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-230c710e-3e69-485d-a732-8809d433b96d req-7e1f8c4a-5cf2-4f11-9512-f53a32f6413d service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:10.962693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-230c710e-3e69-485d-a732-8809d433b96d req-7e1f8c4a-5cf2-4f11-9512-f53a32f6413d service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:10.983215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-230c710e-3e69-485d-a732-8809d433b96d req-7e1f8c4a-5cf2-4f11-9512-f53a32f6413d service nova] Creating event network-changed:91086c81-b058-42da-8552-c21268a1fe5f for instance 71aa646b-022b-46dc-a362-fe7d63d90f5a on hv-cinder-84914 Oct 04 05:43:10.989616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-230c710e-3e69-485d-a732-8809d433b96d req-7e1f8c4a-5cf2-4f11-9512-f53a32f6413d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292456 Oct 04 05:43:10.990570 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 24/47] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:11.324742 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:11.325565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:11.341085 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:11.362719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:11.365169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:11.366231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:11.372291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:11.372957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:11.473322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:11.483425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bd21b797-bc16-4a04-9021-4b37930ab977 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.582340 Oct 04 05:43:11.486551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:10 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:11.493580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:11.494408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:11.502783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:11.503458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:11.504045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:11.505451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:11.506050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:11.506643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:11.885226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:11.898219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:11.903634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:11.905276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8eb66e33-f7a3-4602-ad72-1a6f247763da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.595959 Oct 04 05:43:11.919916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:11 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:11.934370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:11.935369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:11.944410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:11.945188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:11.945785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:11.948939 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:11.949839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:11.950733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:12.084835 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:12.112988 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-46589311-ae11-4a6e-bebb-800276d883b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1295 microversion: 2.1 time: 0.191496 Oct 04 05:43:12.113986 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 26/50] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:11 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1295 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:12.203335 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:12.227374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e7c88ad7-0b9a-481a-80ce-128e7239fd9c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.739042 Oct 04 05:43:12.228367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 25/51] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:11 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:12.522564 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:12.524223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:12.533789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:12.534896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:12.535837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:12.536988 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:12.538127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:12.538913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:12.936192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:12.938029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:12.949747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:12.954838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:12.955188 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:12.956620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:12.957536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:12.958329 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:12.958951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:12.968998 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-35fc3b31-aa24-4819-b66d-24ef302dc86b tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.449195 Oct 04 05:43:13.009714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:12 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:13.151219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:13.154325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:13.174216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.178189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.180313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.182950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.183448 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.185703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.392553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:13.401763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9169e303-dac0-4b52-88bb-bfe9282f10a6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1295 microversion: 2.1 time: 0.264437 Oct 04 05:43:13.414615 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:13 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1295 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:13.424566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:13.425210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:13.432116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.432649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.433133 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.434111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.434779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.435364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.552167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:13.586583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:13.586583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:13.586583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4ba82880-680c-4830-890c-ba317b636011 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.638871 Oct 04 05:43:13.586805 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 26/54] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:12 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:13.648978 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:13.698983 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.698983 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.699255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.755862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Creating event network-changed:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:43:13.760495 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 05:43:13.761475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-90c15510-da53-4bff-a8c8-9e3914488d24 req-9626a1fd-0c38-424e-a550-b4ae345d0321 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 05:43:13.763898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.767698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.772542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.775020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:13.775020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:13.775020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:13.797853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.compute.rpcapi [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 05:43:13.798787 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] Releasing lock "compute-rpcapi-router" {{(pid=127393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 05:43:13.828786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1ff59abd-1383-4c6b-b0ad-92aeb080f009 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204554 Oct 04 05:43:13.834071 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 27/55] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:13.857665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=32 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:13.997496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:14.000164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:14.010469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:14.011479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:14.012364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:14.013322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:14.013927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:14.014670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:14.041343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:14.195135 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:14.204352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2cadd22d-9cfc-4c99-ad1e-bde6dbdc8ccc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.788343 Oct 04 05:43:14.206085 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 29/56] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:13 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:14.337299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:14.345121 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ddc9b094-d7b5-4ecb-b6fe-87937e7c48a4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.352518 Oct 04 05:43:14.350204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 28/57] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:13 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:14.428757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:14.429367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:14.435424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:14.435912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:14.436349 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:14.437040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:14.437745 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:14.438188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:14.570950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:14.580163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ace8b396-4704-40ac-8bb8-094a43781712 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.155350 Oct 04 05:43:14.581095 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:14 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:14.598783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:14.598783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:14.603756 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:14.604240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:14.604674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:14.605362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:14.605806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:14.606340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:14.750235 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:14.759730 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:14.761720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:14.763002 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-85aaa44f-7b4e-4b2f-883e-33f0eda71c19 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.170129 Oct 04 05:43:14.763665 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 29/59] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:14 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:15.227947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:15.228555 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:15.234552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.235035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.235473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.236157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.237274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.237739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.255204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:15.368436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:15.369114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:15.371078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:15.372336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:15.378269 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.378937 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.379330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.380186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.381015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.381165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-10f0a4ad-c977-4b3c-8594-6f1622a359d2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.156972 Oct 04 05:43:15.381554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.381728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 31/60] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:15 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:15.520012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:15.528101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-80bca7e9-3cfb-48fd-bfd4-27a515eb7a60 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.163478 Oct 04 05:43:15.528755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 30/61] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:15 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:15.603015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:15.603614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:15.609861 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.610376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.610808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.611557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.612039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.612458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.743151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:15.750676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-93d27017-fd3b-4d32-88a5-539914280da5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.151504 Oct 04 05:43:15.751229 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 32/62] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:15 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:15.788878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:15.789478 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:15.795527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.796021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.796455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.797152 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:15.797602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:15.798022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:15.926375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:15.934422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:15.935858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:15.936938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-086aad75-84f1-48b2-aada-cab795d44ee7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.152464 Oct 04 05:43:15.937825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 31/63] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:15 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:16.403359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:16.403965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:16.410309 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.410785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.411213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.411895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.412337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.412758 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.551745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:16.552372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:16.554106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=18 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:16.559234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.559715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.560195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.560887 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.561331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.561752 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.562328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:16.574052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a9c860f2-76f8-450f-a66d-0f6d026c35dd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.174445 Oct 04 05:43:16.574643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 33/64] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:16 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:16.695340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:16.702823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7accd090-7df9-4e75-a0ab-eeb9c89cce91 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.155877 Oct 04 05:43:16.703388 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 32/65] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:16 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:16.773451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:16.774053 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:16.780113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.780589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.781025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.781707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.782237 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.782667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.912824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:16.921322 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0a1f1a7c-46a0-4e9f-b463-c3e9619f8020 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.151553 Oct 04 05:43:16.921994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 34/66] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:16 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:16.962584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:16.963303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:16.970214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.971647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.972294 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:16.972992 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:16.973458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:16.980189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:17.128925 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:17.137483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:17.139034 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:17.140271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7ebdbda3-b11d-4482-ae20-67b552166d0c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.181511 Oct 04 05:43:17.140996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:16 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:17.597530 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:17.598176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:17.604786 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:17.605487 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:17.606130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:17.607008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:17.607633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:17.608194 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:17.726254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:17.727492 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:17.741610 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:17.743144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:17.743144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:17.743656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:17.744118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:17.744786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:17.785946 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:17.797695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-305561d8-f718-46d4-96bb-3070a826272c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.204628 Oct 04 05:43:17.798600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 35/68] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:17 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:17.936286 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:17.946594 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:17.946859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c962e8d5-09b1-429e-8740-c92267381c48 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.224221 Oct 04 05:43:17.947188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:17.948349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:17 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:17.961787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:17.962539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:17.963137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:17.964564 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:17.965245 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:17.965815 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.124987 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:18.134605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-196210c4-4a09-4561-aca5-f950e55fc36a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.193222 Oct 04 05:43:18.135235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 36/70] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:17 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:18.166943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:18.167617 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:18.174068 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:18.174595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:18.175029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.175828 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:18.176281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:18.176704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.330129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:18.338674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:18.340337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:18.341701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-efb6238e-0aec-4085-bf76-2b6dadd863b5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.178910 Oct 04 05:43:18.358494 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 35/71] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:18 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:18.821262 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:18.827028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:18.835821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:18.836265 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:18.836703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.837604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:18.838277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:18.839118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.973523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:18.974122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:18.980784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:18.981496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:18.982099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.983283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:18.983894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:18.984626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:18.999461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:19.013340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b997415e-f510-4e78-82de-425968613ecd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.195944 Oct 04 05:43:19.028553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 37/72] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:18 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:19.129085 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:19.137289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-55455955-8981-4ae3-97b4-b3fd57d41509 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.168225 Oct 04 05:43:19.138200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 36/73] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:18 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:19.159384 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:19.160213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:19.167195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:19.167907 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:19.168512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:19.169516 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:19.170059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:19.170514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:19.368434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:19.369418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:19.383559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:19.386346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:19.386797 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:19.387521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:19.388145 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:19.388790 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:19.413842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:19.432301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6ce42c6e-8d12-4733-8a50-5d0ce645bbda tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.277670 Oct 04 05:43:19.433328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 38/74] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:19 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:19.568385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:19.577898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:19.581476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:19.581476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3174d39e-36f4-479f-9c7c-dbc16f20290a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.217532 Oct 04 05:43:19.598326 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 37/75] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:19 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:20.035833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:20.037582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:20.044288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.044765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.045193 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.045877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.046394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.046865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.161707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:20.162356 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:20.168255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.168717 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.169186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.169866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.170341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.170765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.289936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:20.298421 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-17888e13-61e5-4fae-a171-f7838a2034da tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.266366 Oct 04 05:43:20.299160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 39/76] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:20 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:20.381484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:20.389213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-531f9088-6a0b-4b49-baf0-51aef1094ff7 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.232102 Oct 04 05:43:20.389851 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 38/77] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:20 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:20.461380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:20.461948 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:20.468064 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.468551 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.468979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.469669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.470115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.470601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.502464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=8 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:20.608806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:20.608989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:20.610089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:20.616312 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.616802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.617263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.617928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:20.618529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:20.618973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:20.621261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9b8b2d0d-12d4-43ce-9dd8-6eb8a1daec52 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.163888 Oct 04 05:43:20.622471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 40/78] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:20 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:20.908276 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:20.915399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:20.916860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:20.917982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-196692bd-0a61-497f-98c3-3b14583779b8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.314966 Oct 04 05:43:20.918583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 39/79] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:20 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:21.119278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-ba722b98-e1e1-46ec-9ae3-c54417b092c4 req-d164e415-d325-4962-a5c6-19d7866add25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8f1069-3555-4673-a945-1e45b7a35999", "tag": "5ced9537-26c4-4d6d-a357-ce2a56da3e84"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:21.130430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-ba722b98-e1e1-46ec-9ae3-c54417b092c4 req-d164e415-d325-4962-a5c6-19d7866add25 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.131021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-ba722b98-e1e1-46ec-9ae3-c54417b092c4 req-d164e415-d325-4962-a5c6-19d7866add25 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.131739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-ba722b98-e1e1-46ec-9ae3-c54417b092c4 req-d164e415-d325-4962-a5c6-19d7866add25 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.146634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-ba722b98-e1e1-46ec-9ae3-c54417b092c4 req-d164e415-d325-4962-a5c6-19d7866add25 service nova] Creating event network-changed:5ced9537-26c4-4d6d-a357-ce2a56da3e84 for instance fb8f1069-3555-4673-a945-1e45b7a35999 on hv-cinder-84914 Oct 04 05:43:21.154282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-ba722b98-e1e1-46ec-9ae3-c54417b092c4 req-d164e415-d325-4962-a5c6-19d7866add25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036432 Oct 04 05:43:21.154282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 41/80] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:21.322105 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:21.322777 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:21.328742 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.334340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.334340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.334340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.334340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.334852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.412385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:21.413072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:21.419305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.419780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.420210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.420896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.421347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.421765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.465215 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:21.473908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-35cdaf74-f73d-4a34-ae10-f051e7fb6fcc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.155228 Oct 04 05:43:21.475006 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 40/81] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:21 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:21.558068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:21.566093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c430d2b5-fd08-4d1f-8437-0e0c4903f761 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.157829 Oct 04 05:43:21.566692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 42/82] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:21 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:21.644655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:21.645289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:21.651333 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.651799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.652267 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.652978 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.653438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.653860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.780639 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:21.788929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-79e7ab3d-0578-44b4-9d23-d164d5f606e0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.148793 Oct 04 05:43:21.789507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 41/83] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:21 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:21.943325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:21.944217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:21.950132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.950635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.951063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:21.951775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:21.952218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:21.952635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:22.081225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:22.089422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:22.090898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:22.091991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2f61dbe8-00d9-4785-a9a8-1f0394085dbf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.153195 Oct 04 05:43:22.092591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 43/84] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:21 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:22.497699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:22.498371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:22.504699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:22.505192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:22.505626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:22.506357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:22.506807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:22.507232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:22.589337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:22.590671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:22.597893 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:22.598471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:22.598950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:22.599690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:22.600151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:22.600576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:22.692700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:22.701785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1d12857d-30cf-4921-a09c-927cb6dedc75 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.208030 Oct 04 05:43:22.702634 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 42/85] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:22 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:22.746280 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:22.754015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cf48bca3-be6e-4346-974f-5c7c5568bf0e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.168866 Oct 04 05:43:22.754676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:22 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:22.811842 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:22.812786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:22.819606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:22.820094 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:22.820603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:22.821400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:22.821859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:22.822314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.117881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:23.118596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:23.126538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:23.126538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:23.126718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:23.126818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.126818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:23.127248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:23.127669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.144774 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e24fd789-a606-458c-a515-1ec685844b9d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.336954 Oct 04 05:43:23.162694 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 43/87] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:22 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:23.302919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:23.311705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:23.313526 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:23.320292 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-26e02021-059b-407c-9f6b-fe65d754d67e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.201304 Oct 04 05:43:23.320292 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 45/88] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:23 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:23.725646 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:23.733891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:23.733891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:23.733891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:23.734540 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.735531 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:23.736026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:23.736614 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.778291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:23.784390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:23.794266 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:23.795028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:23.795637 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.796339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:23.797088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:23.797517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:23.798254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:23.928360 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:23.937182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4d272083-3682-47fc-92f0-7a859ea1485d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.215730 Oct 04 05:43:23.945906 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:23 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:23.957751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:23.965715 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a76fdf99-34a4-4e82-883c-1fcac4f1529e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.192472 Oct 04 05:43:23.966293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 46/90] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:23 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:24.176559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:24.177204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:24.193379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.193615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.194197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.194833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.195314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.195734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.201870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:24.327730 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:24.335744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-89d331d0-4228-4d62-8197-814d0db20dc7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.164940 Oct 04 05:43:24.336569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:24 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:24.341629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:24.342484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:24.354332 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.354332 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.357038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.359157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.363917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.364380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.508863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:24.516920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:24.518980 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:24.520185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8108e637-d240-4f38-afac-add3a654ce1c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.183038 Oct 04 05:43:24.520750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 47/92] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:24 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:24.964144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:24.964847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:24.972187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.972736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.973344 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.974389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.974912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.975415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.989471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:24.990073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:24.996651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.997310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.997743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:24.998689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:24.999139 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:24.999755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:25.131902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:25.138347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:25.144203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:25.147094 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2f758b56-fd93-41a1-a065-264240a85eaf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.187830 Oct 04 05:43:25.147685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 46/93] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:24 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:25.152514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d7e4fe13-1800-4049-8cfc-34fcf1286522 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.167476 Oct 04 05:43:25.153080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 48/94] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:24 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:25.368494 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:25.369217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:25.375262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:25.375740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:25.376166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:25.376853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:25.377300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:25.378384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:25.545260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:25.545897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:25.552549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:25.553091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:25.553622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:25.554527 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:25.555097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:25.555646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:25.671225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:25.679018 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-011c939a-37e5-4a5e-a95f-98e17928b022 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.314366 Oct 04 05:43:25.679597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 47/95] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:25 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:25.694916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:25.703567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:25.705018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:25.706862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4ac5267d-8165-4c5e-bc71-3c02868de7dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.165101 Oct 04 05:43:25.707424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 49/96] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:25 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:43:26.170303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:26.171840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:26.176060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:26.179610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:26.180320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.181077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.181696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.182613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.183013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.183193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.183511 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.183901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.184002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.184591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.185035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.185451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.322472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:26.331412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a67ad473-3efc-40b0-a465-f3477e0f0f55 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.160031 Oct 04 05:43:26.332380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 50/97] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:26 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:26.345998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:26.355947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-27989788-708e-43d8-b45a-13fff40cee84 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.189561 Oct 04 05:43:26.356297 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 48/98] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:26 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:26.704693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:26.705310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:26.712477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.713136 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.713573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.714360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.714815 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.715242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.736082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:26.736697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:26.744956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.745480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.745875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.746594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:26.747038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:26.747458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:26.866499 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:26.874808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1da67f9b-d0fe-4966-bab7-e09037b9e932 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.174044 Oct 04 05:43:26.875672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:26 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:27.075220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:27.086430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:27.103740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:27.105113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a3f43cbb-82f2-4a0e-9b16-95ca22516f6e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.375556 Oct 04 05:43:27.109431 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 49/100] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:26 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:27.356125 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:27.360627 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:27.369900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.372758 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.373203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:27.373917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.374438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.374823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:27.385910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:27.387734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:27.396761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.397919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.399095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:27.401008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.401731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.402533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:27.686544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:27.703009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-43df5640-f359-485b-b3c0-3bdf6b86d71f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.345710 Oct 04 05:43:27.703009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 52/101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:27 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:27.796620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:27.807867 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7f1e402e-d224-4258-a9da-3e004846eb93 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.427788 Oct 04 05:43:27.809010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 50/102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:27 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:27.832296 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-490048dd-b4e9-477d-9f4e-f62365814354 req-312557e8-b660-42bd-a389-3a6e51fab8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71aa646b-022b-46dc-a362-fe7d63d90f5a", "name": "network-vif-plugged", "status": "completed", "tag": "91086c81-b058-42da-8552-c21268a1fe5f"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:27.844208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-490048dd-b4e9-477d-9f4e-f62365814354 req-312557e8-b660-42bd-a389-3a6e51fab8ca service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.845049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-490048dd-b4e9-477d-9f4e-f62365814354 req-312557e8-b660-42bd-a389-3a6e51fab8ca service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.845804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-490048dd-b4e9-477d-9f4e-f62365814354 req-312557e8-b660-42bd-a389-3a6e51fab8ca service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:27.859231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-490048dd-b4e9-477d-9f4e-f62365814354 req-312557e8-b660-42bd-a389-3a6e51fab8ca service nova] Creating event network-vif-plugged:91086c81-b058-42da-8552-c21268a1fe5f for instance 71aa646b-022b-46dc-a362-fe7d63d90f5a on hv-cinder-84914 Oct 04 05:43:27.865170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-490048dd-b4e9-477d-9f4e-f62365814354 req-312557e8-b660-42bd-a389-3a6e51fab8ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166340 Oct 04 05:43:27.865765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 53/103] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:27.898873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:27.899307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:27.906111 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.906683 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.907119 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:27.907809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:27.908254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:27.909196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:28.039129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:28.046756 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-79f1702b-881e-4242-8d14-c2930b9c8413 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.152052 Oct 04 05:43:28.047326 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 51/104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:27 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:28.134821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:28.135429 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:28.141707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:28.142370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:28.142967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:28.144265 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:28.144997 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:28.145581 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:28.272951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:28.281073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:28.282540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:28.283629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3f784248-94c9-4ac0-aaf1-339f122a9a4c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.153165 Oct 04 05:43:28.284777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 54/105] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:28 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:28.720959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:28.722266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:28.732025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:28.732025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:28.732025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:28.732025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:28.734879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:28.734879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:28.837592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:28.838904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:28.845402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:28.846006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:28.847911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:28.847911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:28.847911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:28.848660 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:29.050223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:29.060448 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-70b30e86-3019-4f8b-9b6b-a7cbc281d16b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.226471 Oct 04 05:43:29.061471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 55/106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:28 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:29.070072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:29.071325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:29.080999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:29.081701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:29.082155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:29.083037 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:29.083495 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:29.083918 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:29.109667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:29.119500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e90e13a6-0b4b-411d-b9c9-708eaef70e1a tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.402422 Oct 04 05:43:29.120088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 52/107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:28 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:29.225736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:29.233329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-dce7306f-10fb-43ec-8df1-e892f1d9f8ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.168266 Oct 04 05:43:29.233898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 56/108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:29 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:29.309685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:29.310443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:29.316762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:29.317222 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:29.317659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:29.318381 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:29.318831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:29.319253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:29.526986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:29.535671 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:29.538354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:29.539546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-226d93c1-96c4-4111-8be6-59fa7af31e2e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.234184 Oct 04 05:43:29.558443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 53/109] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:29 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:29.880791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-f39ee4c7-1cbb-4fae-bf5b-d7d820887c1c req-8682b69d-169e-4b77-8c03-1871a0c229b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226a13ae-7a83-488a-9e42-7f524be2114c", "name": "network-vif-plugged", "status": "completed", "tag": "dc0907bd-05c2-480f-a9cd-803e9153eda6"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:29.890453 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-f39ee4c7-1cbb-4fae-bf5b-d7d820887c1c req-8682b69d-169e-4b77-8c03-1871a0c229b9 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:29.891268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-f39ee4c7-1cbb-4fae-bf5b-d7d820887c1c req-8682b69d-169e-4b77-8c03-1871a0c229b9 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:29.891385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-f39ee4c7-1cbb-4fae-bf5b-d7d820887c1c req-8682b69d-169e-4b77-8c03-1871a0c229b9 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:29.920675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-f39ee4c7-1cbb-4fae-bf5b-d7d820887c1c req-8682b69d-169e-4b77-8c03-1871a0c229b9 service nova] Creating event network-vif-plugged:dc0907bd-05c2-480f-a9cd-803e9153eda6 for instance 226a13ae-7a83-488a-9e42-7f524be2114c on hv-cinder-84914 Oct 04 05:43:29.925821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-f39ee4c7-1cbb-4fae-bf5b-d7d820887c1c req-8682b69d-169e-4b77-8c03-1871a0c229b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049250 Oct 04 05:43:29.926462 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 57/110] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:30.086108 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:30.086741 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:30.092816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.093361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.093785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.094490 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.094962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.095378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.146374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:30.147063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:30.153475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.154131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.154709 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.156342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.156833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.161918 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.259761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:30.269238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eb33d7c0-afa2-4bc0-971d-0de172b59ac9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.186865 Oct 04 05:43:30.270065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 54/111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:30 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:30.276135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:30.280503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:30.294073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.294734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.295249 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.296036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.296748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.297422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.359818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:30.368282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7925df44-c6df-4f18-b77b-d6eb4118c7e1 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.226903 Oct 04 05:43:30.368869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 58/112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:30 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:30.453307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:30.466066 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fd910d69-dbed-41bf-9c6e-f967309111fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.194670 Oct 04 05:43:30.476475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 55/113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:30 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:30.564490 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:30.566163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:30.575069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.575586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.576170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.576874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:30.577320 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:30.578451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:30.800128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:30.808316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:30.809763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:30.810926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a00f891f-339b-48a4-839a-155968ec29c5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.251410 Oct 04 05:43:30.811531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 59/114] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:30 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:31.295891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:31.296503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:31.303618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.304098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.304750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.305768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.306521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.306949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.392014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:31.393312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:31.402662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.403473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.404090 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.405040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.405689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.406268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.446580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:31.455418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-59774125-4443-4e35-bf30-603b0febd244 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1365 microversion: 2.1 time: 0.163638 Oct 04 05:43:31.456078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 56/115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:31 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:31.489076 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:31.489800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:31.496153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.496629 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.497058 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.497745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.498254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.503847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.547928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:31.559337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2788c225-2af3-430e-aefe-11f4f38e4203 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.169610 Oct 04 05:43:31.559615 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 60/116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:31 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:31.633776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:31.642567 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2b48545c-81d0-401b-b21a-980f8357c283 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.157596 Oct 04 05:43:31.643692 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 57/117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:31 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:31.840145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:31.840985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:31.848370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.848863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.849300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.850006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:31.850667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:31.851099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:31.981090 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:31.991810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:31.993390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:31.994532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-18b5a395-3d22-4ed4-a622-f914af3fb8f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.158297 Oct 04 05:43:31.995440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 61/118] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:31 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:32.098372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-6f7f90ec-fcb8-404c-b109-cfb87e76cc1e req-c47d5eee-49ec-4b11-8efa-03f3c55c3d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "name": "network-vif-plugged", "status": "completed", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:32.108089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6f7f90ec-fcb8-404c-b109-cfb87e76cc1e req-c47d5eee-49ec-4b11-8efa-03f3c55c3d24 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.108559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6f7f90ec-fcb8-404c-b109-cfb87e76cc1e req-c47d5eee-49ec-4b11-8efa-03f3c55c3d24 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.108984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6f7f90ec-fcb8-404c-b109-cfb87e76cc1e req-c47d5eee-49ec-4b11-8efa-03f3c55c3d24 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.121434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-6f7f90ec-fcb8-404c-b109-cfb87e76cc1e req-c47d5eee-49ec-4b11-8efa-03f3c55c3d24 service nova] Creating event network-vif-plugged:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:43:32.126810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-6f7f90ec-fcb8-404c-b109-cfb87e76cc1e req-c47d5eee-49ec-4b11-8efa-03f3c55c3d24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032180 Oct 04 05:43:32.127948 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 58/119] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:32.479664 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:32.481471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:32.493467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.495164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.495614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.497534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.498195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.499383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.583491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:32.584686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:32.591391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.591873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.592324 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.592988 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.593556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.593986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.713883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:32.722691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1d9d07ed-ccef-4be6-9da9-662c2fa38dfd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1555 microversion: 2.1 time: 0.248066 Oct 04 05:43:32.723699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 62/120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:32 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:32.728510 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:32.734293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:32.735765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.736477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.737395 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.738465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.739100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.740423 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.814835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:32.823199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0a03ff9b-5f60-44a5-88e2-3a7ab595de40 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1315 microversion: 2.1 time: 0.244595 Oct 04 05:43:32.823828 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 59/121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:32 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:32.835415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:32.835415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:32.837116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.837831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.838492 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.839386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:32.840170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:32.840758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:32.973264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:32.983036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bceaec02-d9cd-4f01-92bb-7ffceb16f6ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.258098 Oct 04 05:43:32.984080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 63/122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:32 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:33.022942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:33.025184 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:33.036588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2dde7114-e56a-401a-bfc6-2f5b3ef8c1fd tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211215 Oct 04 05:43:33.037355 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 60/123] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:43:32 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:33.044846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:33.044846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:33.045256 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:33.045893 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:33.046441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:33.047517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:33.368904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:33.380467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:33.382207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:33.383363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e821c46a-2919-40e5-b297-d91cfd3578c2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.366696 Oct 04 05:43:33.386690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 64/124] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:33 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:33.847672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:33.848284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:33.854639 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:33.855380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:33.855969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:33.856894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:33.857515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:33.858100 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.006964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:34.007571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:34.007924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:34.014277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:34.019996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:34.019996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.019996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:34.019996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:34.020478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.021309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-de90a7a7-56d1-474a-9b35-81adbbf5780f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1502 microversion: 2.1 time: 0.178004 Oct 04 05:43:34.022192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 61/125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:33 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:34.153936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-8038ba1e-2cc3-4275-a348-1ca3cd2ffff3 req-218db5e3-53e7-4978-a67e-51e12c890064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8f1069-3555-4673-a945-1e45b7a35999", "name": "network-vif-plugged", "status": "completed", "tag": "5ced9537-26c4-4d6d-a357-ce2a56da3e84"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:34.184144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-8038ba1e-2cc3-4275-a348-1ca3cd2ffff3 req-218db5e3-53e7-4978-a67e-51e12c890064 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:34.185424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-8038ba1e-2cc3-4275-a348-1ca3cd2ffff3 req-218db5e3-53e7-4978-a67e-51e12c890064 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:34.188940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-8038ba1e-2cc3-4275-a348-1ca3cd2ffff3 req-218db5e3-53e7-4978-a67e-51e12c890064 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.214814 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-8038ba1e-2cc3-4275-a348-1ca3cd2ffff3 req-218db5e3-53e7-4978-a67e-51e12c890064 service nova] Creating event network-vif-plugged:5ced9537-26c4-4d6d-a357-ce2a56da3e84 for instance fb8f1069-3555-4673-a945-1e45b7a35999 on hv-cinder-84914 Oct 04 05:43:34.222258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:34.223809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-8038ba1e-2cc3-4275-a348-1ca3cd2ffff3 req-218db5e3-53e7-4978-a67e-51e12c890064 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074725 Oct 04 05:43:34.230041 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 62/126] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:43:34.231943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8cdeb719-2e0a-4e23-b7b1-9d3046ac1e0d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.228620 Oct 04 05:43:34.232568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 65/127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:34 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:34.409032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:34.409797 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:34.415936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:34.416488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:34.416990 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.417741 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:34.418290 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:34.418799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.437078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:34.573892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:34.583004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:34.584497 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:34.585801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a3b093c4-9306-480b-9dcf-0309c2cc5181 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1405 microversion: 2.20 time: 0.181008 Oct 04 05:43:34.586404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 63/128] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:34 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:34.705351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-d0f44a88-c26f-4e8d-9300-c09232315bb6 req-c6cac406-6bc8-4ef0-8b12-89ad35dc8974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71aa646b-022b-46dc-a362-fe7d63d90f5a", "tag": "91086c81-b058-42da-8552-c21268a1fe5f"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:34.715070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-d0f44a88-c26f-4e8d-9300-c09232315bb6 req-c6cac406-6bc8-4ef0-8b12-89ad35dc8974 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:34.715532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-d0f44a88-c26f-4e8d-9300-c09232315bb6 req-c6cac406-6bc8-4ef0-8b12-89ad35dc8974 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:34.715913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-d0f44a88-c26f-4e8d-9300-c09232315bb6 req-c6cac406-6bc8-4ef0-8b12-89ad35dc8974 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:34.730638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-d0f44a88-c26f-4e8d-9300-c09232315bb6 req-c6cac406-6bc8-4ef0-8b12-89ad35dc8974 service nova] Creating event network-changed:91086c81-b058-42da-8552-c21268a1fe5f for instance 71aa646b-022b-46dc-a362-fe7d63d90f5a on hv-cinder-84914 Oct 04 05:43:34.743014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-d0f44a88-c26f-4e8d-9300-c09232315bb6 req-c6cac406-6bc8-4ef0-8b12-89ad35dc8974 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040859 Oct 04 05:43:34.743921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 66/129] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:35.254953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:35.256198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:35.262747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.265113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.265113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.265113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.265113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.265421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.403202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:35.411449 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-88b2366d-a38d-43cb-a843-e30a5e5a3c5e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.160702 Oct 04 05:43:35.412128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 64/130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:35 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:35.611727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:35.612424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:35.624318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.624318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.624318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.624318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.624860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.624860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.640255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:35.763055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:35.776099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:35.780225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:35.780225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5f28e457-1d59-48e0-b7f1-8238266f82b3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1597 microversion: 2.20 time: 0.171599 Oct 04 05:43:35.780225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 67/131] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:43:35 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1597 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:43:35.806001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:35.806526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:35.813038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.813909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.827566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.829635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.830753 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.831204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.889279 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4affafe-d7a3-4876-a74c-e6fa5a55eb97"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:35.895418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:35.912239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.912977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.913571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.914317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:35.914773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:35.915195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:35.931675 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e3af178e-f7ad-4d65-8459-7bb7a7d19c9e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.129570 Oct 04 05:43:35.932367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 65/132] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 4 05:43:35 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 05:43:36.434937 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:36.436403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:36.444207 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:36.444875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:36.445450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:36.446821 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:36.447550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:36.453800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:37.084607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:37.093172 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bd21ecf3-58ad-43c8-be57-4281225a0bf4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1363 microversion: 2.1 time: 0.662540 Oct 04 05:43:37.093758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:36 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1363 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:37.707856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-0772e61a-e094-4bbc-bf7c-04d17b0a91f1 req-92a005be-299c-4778-8d9d-ac600d82d8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:37.717910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0772e61a-e094-4bbc-bf7c-04d17b0a91f1 req-92a005be-299c-4778-8d9d-ac600d82d8cc service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:37.718438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0772e61a-e094-4bbc-bf7c-04d17b0a91f1 req-92a005be-299c-4778-8d9d-ac600d82d8cc service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:37.718871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0772e61a-e094-4bbc-bf7c-04d17b0a91f1 req-92a005be-299c-4778-8d9d-ac600d82d8cc service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:37.730514 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-0772e61a-e094-4bbc-bf7c-04d17b0a91f1 req-92a005be-299c-4778-8d9d-ac600d82d8cc service nova] Creating event network-changed:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:43:37.735969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-0772e61a-e094-4bbc-bf7c-04d17b0a91f1 req-92a005be-299c-4778-8d9d-ac600d82d8cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Oct 04 05:43:37.736757 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 67/134] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:43:37.855810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-57c32104-6578-4ef8-91ab-c1a443a53246 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "POST /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.970434 Oct 04 05:43:37.859235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 68/135] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:43:35 2022] POST /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c/os-volume_attachments => generated 194 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:38.118874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:38.119681 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:38.130820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:38.131414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:38.131958 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:38.132848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:38.133898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:38.136041 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:38.304167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:38.312477 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-13b0aef8-975b-46fd-8652-8acf460e60fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1548 microversion: 2.1 time: 0.198159 Oct 04 05:43:38.313129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 68/136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:38 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:38.339880 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:38.348276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:38.359051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:38.359572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:38.360118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:38.361372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:38.361372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:38.361708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:38.468461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-272c546b-7374-4ce4-b252-3ccb00a1fda1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135366 Oct 04 05:43:38.469538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 69/137] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:43:38 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:39.688007 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-db6211f4-36c4-43c5-a86a-24e906aea405 req-a49c1b28-df6a-4a3f-aace-3e58ea68463e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8f1069-3555-4673-a945-1e45b7a35999", "tag": "5ced9537-26c4-4d6d-a357-ce2a56da3e84"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:39.709662 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-db6211f4-36c4-43c5-a86a-24e906aea405 req-a49c1b28-df6a-4a3f-aace-3e58ea68463e service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:39.711779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-db6211f4-36c4-43c5-a86a-24e906aea405 req-a49c1b28-df6a-4a3f-aace-3e58ea68463e service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:39.712201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-db6211f4-36c4-43c5-a86a-24e906aea405 req-a49c1b28-df6a-4a3f-aace-3e58ea68463e service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:39.728291 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-db6211f4-36c4-43c5-a86a-24e906aea405 req-a49c1b28-df6a-4a3f-aace-3e58ea68463e service nova] Creating event network-changed:5ced9537-26c4-4d6d-a357-ce2a56da3e84 for instance fb8f1069-3555-4673-a945-1e45b7a35999 on hv-cinder-84914 Oct 04 05:43:39.733796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-db6211f4-36c4-43c5-a86a-24e906aea405 req-a49c1b28-df6a-4a3f-aace-3e58ea68463e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050500 Oct 04 05:43:39.735304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 69/138] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:52.191799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=94 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:52.192552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:52.196676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:52.197170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:52.206450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:52.206450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:52.206450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:52.206450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:52.207261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:52.207865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:52.241050 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:43:52.616344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5bdf4da9-6c72-4c88-ac1d-608dd1af86fc tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 204 len: 0 microversion: 2.1 time: 0.426430 Oct 04 05:43:52.617121 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:43:52 2022] DELETE /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:43:52.625851 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:52.626965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:52.629252 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=79 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:52.629989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=28 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:43:52.634928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:52.635409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:52.635839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:52.636581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:52.637012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:52.637435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:52.768282 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:52.776319 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-867cb634-f6fc-45eb-a54a-7c9baba8b858 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1554 microversion: 2.1 time: 0.154773 Oct 04 05:43:52.776821 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 70/140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:52 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:53.799775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:53.800459 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:53.807891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:53.808371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:53.808808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:53.809491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:53.809942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:53.810408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:53.942640 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:53.951066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-493fa48c-8cf5-4f16-8401-bdb0dcda6f4e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1554 microversion: 2.1 time: 0.155684 Oct 04 05:43:53.951601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 71/141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:53 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:54.407228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2135613660", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:54.459605 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] validate_networks() for None {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:43:54.550730 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1303547808", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "networks": [{"uuid": "3e667155-a3de-4a36-8e04-002d492ba4ce"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:54.603733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] validate_networks() for [('3e667155-a3de-4a36-8e04-002d492ba4ce', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:43:54.750259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:43:54.750686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:43:54.751158 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:43:54.751564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:43:54.752006 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:43:54.763787 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:54.764536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:54.765150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:54.772904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:54.773650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:54.774253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:54.793079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Getting quotas for project 318c2ab91f564d8ba2e29b724c008dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:43:54.797230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Getting quotas for user cadc251db5cf4e24a3fc8ffab6e9b9ae and project 318c2ab91f564d8ba2e29b724c008dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:43:54.810266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:43:54.812823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:43:54.982431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:43:54.982883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:43:54.987649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:43:54.987649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:43:54.987649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:43:54.993885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:54.994392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:54.994821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:54.995531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:54.996006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:54.996424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:55.019029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Getting quotas for project e003d2bea5f04ac7a70fd2b7d2ee1f91. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:43:55.022304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cdc1eb42-7cd1-4ebf-8536-8d37f9561b5c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617317 Oct 04 05:43:55.022304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 71/142] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:43:55.026222 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:55.027260 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:55.031384 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Getting quotas for user 877575c9e0264241b9eab868a89cbbe8 and project e003d2bea5f04ac7a70fd2b7d2ee1f91. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:43:55.034027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:55.034734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:55.035313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:55.037563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:55.038544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:55.038980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:55.046539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:43:55.049406 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:43:55.184375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-83fb96ac-a062-4879-8735-941a17084476 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637882 Oct 04 05:43:55.185509 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 72/143] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 05:43:55.195882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-09d072e1-129d-4c51-869f-a9d6ffc1a89d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:55.200121 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-09d072e1-129d-4c51-869f-a9d6ffc1a89d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:55.263069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-09d072e1-129d-4c51-869f-a9d6ffc1a89d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:55.271908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-09d072e1-129d-4c51-869f-a9d6ffc1a89d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1215 microversion: 2.1 time: 0.085068 Oct 04 05:43:55.272607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 73/144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:55 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:55.278168 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-11a052f7-e584-4902-ac84-cb724ef77ac3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:55.278808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-11a052f7-e584-4902-ac84-cb724ef77ac3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:55.340930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-11a052f7-e584-4902-ac84-cb724ef77ac3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:55.350864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-11a052f7-e584-4902-ac84-cb724ef77ac3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1219 microversion: 2.1 time: 0.076971 Oct 04 05:43:55.354305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 74/145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:55 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:55.489357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:55.499337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-219eb35f-7988-415d-a5d4-d02389cb54d4 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1554 microversion: 2.1 time: 0.476942 Oct 04 05:43:55.500127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 72/146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:55 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1554 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:56.137571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-20bd6117-d4b5-4ea7-9fb8-bcd95fdfba3a req-7f90f1c1-4bfc-415a-9162-9253f2eef160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226a13ae-7a83-488a-9e42-7f524be2114c", "name": "network-vif-deleted", "tag": "dc0907bd-05c2-480f-a9cd-803e9153eda6"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:43:56.163118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-20bd6117-d4b5-4ea7-9fb8-bcd95fdfba3a req-7f90f1c1-4bfc-415a-9162-9253f2eef160 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:56.165038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-20bd6117-d4b5-4ea7-9fb8-bcd95fdfba3a req-7f90f1c1-4bfc-415a-9162-9253f2eef160 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:56.165541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-20bd6117-d4b5-4ea7-9fb8-bcd95fdfba3a req-7f90f1c1-4bfc-415a-9162-9253f2eef160 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:56.179197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-20bd6117-d4b5-4ea7-9fb8-bcd95fdfba3a req-7f90f1c1-4bfc-415a-9162-9253f2eef160 service nova] Creating event network-vif-deleted:dc0907bd-05c2-480f-a9cd-803e9153eda6 for instance 226a13ae-7a83-488a-9e42-7f524be2114c on hv-cinder-84914 Oct 04 05:43:56.184433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-20bd6117-d4b5-4ea7-9fb8-bcd95fdfba3a req-7f90f1c1-4bfc-415a-9162-9253f2eef160 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051074 Oct 04 05:43:56.185246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 75/147] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:43:56.296015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-859653bc-6d50-4de8-9cdb-86f24ae0c71d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:56.296767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-859653bc-6d50-4de8-9cdb-86f24ae0c71d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:56.349230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-859653bc-6d50-4de8-9cdb-86f24ae0c71d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:56.356481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-859653bc-6d50-4de8-9cdb-86f24ae0c71d tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1215 microversion: 2.1 time: 0.064249 Oct 04 05:43:56.357052 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 73/148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:56 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:56.375967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3ec0b1ca-a964-4a67-bb4d-f7ae98794310 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:56.376655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3ec0b1ca-a964-4a67-bb4d-f7ae98794310 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:56.428968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3ec0b1ca-a964-4a67-bb4d-f7ae98794310 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:56.435846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3ec0b1ca-a964-4a67-bb4d-f7ae98794310 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1219 microversion: 2.1 time: 0.064195 Oct 04 05:43:56.436415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 76/149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:56 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:56.523399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:56.524025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:56.529916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:56.530427 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:56.530859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:56.531535 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:56.531977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:56.532396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:56.600150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:56.608724 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-185454d0-5fce-48ec-9dc0-5f1c0e457e1f tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1346 microversion: 2.1 time: 0.089137 Oct 04 05:43:56.609292 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 74/150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:56 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:57.380936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:57.381545 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:57.389553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.390033 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.390565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.391286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.391737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.392156 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.459127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:57.459707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:57.460319 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:57.465203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-049b0abf-7ae3-4bb9-a085-78b5c03e9989 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1267 microversion: 2.1 time: 0.088702 Oct 04 05:43:57.465971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 77/151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:57 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:57.466682 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.467146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.467586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.468278 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.468906 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.469338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.531927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:57.554532 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1c8f490c-42ed-4033-84d7-e52ead181977 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1215 microversion: 2.1 time: 0.084066 Oct 04 05:43:57.554532 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 75/152] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:57 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:57.631192 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:57.631806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:57.637951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.638469 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.638954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.639775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.640233 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.640659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.672109 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:57.672605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:57.673023 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:57.673479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lazy-loading 'fault' on Instance uuid 226a13ae-7a83-488a-9e42-7f524be2114c {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:43:57.718005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:57.726723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b43811f9-8912-415d-9d60-114dd7b77b5e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1351 microversion: 2.1 time: 0.099525 Oct 04 05:43:57.727338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 78/153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:57 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:58.490556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:58.494916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:58.497232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.497716 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.498165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.498858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.499307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.499732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.571265 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:58.576979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:58.578484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:58.579919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-41e0ef25-878b-4bae-b16b-b19b1612d152 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1273 microversion: 2.1 time: 0.093753 Oct 04 05:43:58.580505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 76/154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:58 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:58.586830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.590942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.590942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.590942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.590942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.591726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.654123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:58.667635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-84f67717-9a68-4fbe-8114-8ba7c9102016 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1271 microversion: 2.1 time: 0.094328 Oct 04 05:43:58.668374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 79/155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:58 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:43:58.750424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:58.751027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:58.757583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.758068 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.758532 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.759227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.759671 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.760091 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.791081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:58.791636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:58.792182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:58.792695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lazy-loading 'fault' on Instance uuid 226a13ae-7a83-488a-9e42-7f524be2114c {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:43:58.849169 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:58.858801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-71b16c19-c0f8-4ca5-be99-b47ef4c0b036 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1351 microversion: 2.1 time: 0.112349 Oct 04 05:43:58.859391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 77/156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:58 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:59.603228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:59.603885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:59.610993 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.616514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.616514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.616514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.616514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.617832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.691626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:59.692370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:59.700905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.701835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.702744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.703711 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.704013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.704625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.761894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:59.771396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-04f8e6ca-4a92-4660-ae3c-783bfaf2090a tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.172068 Oct 04 05:43:59.800544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 80/157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:59 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:59.800856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:59.808381 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-67dbc1c3-2dc7-407a-ae95-9fe54e9436f3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1289 microversion: 2.1 time: 0.121301 Oct 04 05:43:59.808945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 78/158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:59 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:43:59.883215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:43:59.883916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:43:59.892460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.893331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.894538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.895392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.895982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.896558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.929140 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:43:59.932180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:43:59.932180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:43:59.932180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lazy-loading 'fault' on Instance uuid 226a13ae-7a83-488a-9e42-7f524be2114c {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:43:59.989282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d1d5de04c894a2ab780bcdee15f5c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b427232479e14a6fa576f4461032f12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:43:59.997590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8a660789-861a-4504-8a1c-184fd71287f3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 200 len: 1351 microversion: 2.1 time: 0.119511 Oct 04 05:43:59.998173 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 81/159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:43:59 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:00.790943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-b71b6f85-e1a5-4d3b-b2df-7b8588d6ae42 req-3c765f0d-c60a-4e17-be51-611fb305f848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32012bae-aedb-43a2-b9fd-51dae912067e", "tag": "0c4a70b8-b109-41f3-b954-ceb15a1901e0"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:00.795136 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:00.795806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:00.802253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b71b6f85-e1a5-4d3b-b2df-7b8588d6ae42 req-3c765f0d-c60a-4e17-be51-611fb305f848 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:00.802929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b71b6f85-e1a5-4d3b-b2df-7b8588d6ae42 req-3c765f0d-c60a-4e17-be51-611fb305f848 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:00.803273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:00.803680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b71b6f85-e1a5-4d3b-b2df-7b8588d6ae42 req-3c765f0d-c60a-4e17-be51-611fb305f848 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:00.803973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:00.804440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:00.805264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:00.806883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:00.807452 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:00.815905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-b71b6f85-e1a5-4d3b-b2df-7b8588d6ae42 req-3c765f0d-c60a-4e17-be51-611fb305f848 service nova] Creating event network-changed:0c4a70b8-b109-41f3-b954-ceb15a1901e0 for instance 32012bae-aedb-43a2-b9fd-51dae912067e on hv-cinder-84914 Oct 04 05:44:00.821179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-b71b6f85-e1a5-4d3b-b2df-7b8588d6ae42 req-3c765f0d-c60a-4e17-be51-611fb305f848 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033911 Oct 04 05:44:00.822292 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 79/160] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:00.832897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:00.834482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:00.843125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:00.843125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:00.843593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:00.844658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:00.845307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:00.845893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:00.982307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:00.990309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1745194d-bb0d-4cc9-97cf-76b8fb5772db tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.162161 Oct 04 05:44:00.990913 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 80/161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:00 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:01.002817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:01.010655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8d22662a-c86e-4f10-a398-a2b3baa2f394 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.220128 Oct 04 05:44:01.012900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 82/162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:00 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:01.021121 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:01.021726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:01.027884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:01.028566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:01.029118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:01.030088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:01.030325 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:01.031247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:01.045615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] HTTP exception thrown: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Request method failure captured: Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c HTTP/1.1 Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8feU_EqcxIL78ZOL04GBfH_9b0FuRejHzTLu9GKntn-U9ZvLeuOE6muI6r_BdQd__VogDRVBiTai9VnZxiLKgRO5k2CmNCxn5ONSmTMlVCpqdbGRe5fvSM87AQVkvtk_R7rD6Zp4nhy0FXKyZxBsYROe8oAH9x6oXQvmvDKBLzBaJA Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:44:01.050839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b427232479e14a6fa576f4461032f12b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b427232479e14a6fa576f4461032f12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}] Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 9d1d5de04c894a2ab780bcdee15f5c5b Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.052361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '226a13ae-7a83-488a-9e42-7f524be2114c'} Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:44:01.053143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.054262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.055257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Returning 404 to user: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:44:01.055257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-badebf98-987f-479f-81df-7b1b255bcd7e tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 404 len: 111 microversion: 2.1 time: 0.035939 Oct 04 05:44:01.055257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 81/163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:01 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:44:01.171800 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:01.174004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:01.179924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:01.180399 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:01.180824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:01.181696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:01.182160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:01.182633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:01.195633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] HTTP exception thrown: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Request method failure captured: Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c/os-volume_attachments HTTP/1.1 Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8feU_EqcxIL78ZOL04GBfH_9b0FuRejHzTLu9GKntn-U9ZvLeuOE6muI6r_BdQd__VogDRVBiTai9VnZxiLKgRO5k2CmNCxn5ONSmTMlVCpqdbGRe5fvSM87AQVkvtk_R7rD6Zp4nhy0FXKyZxBsYROe8oAH9x6oXQvmvDKBLzBaJA Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:44:01.200561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b427232479e14a6fa576f4461032f12b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b427232479e14a6fa576f4461032f12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}] Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 9d1d5de04c894a2ab780bcdee15f5c5b Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.201773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'server_id': '226a13ae-7a83-488a-9e42-7f524be2114c'} Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:44:01.202521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:01.203902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:01.204943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Returning 404 to user: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:44:01.204943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-72948957-aff5-4e96-b1e7-c020c3035ab6 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034182 Oct 04 05:44:01.204943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 83/164] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:44:01 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:44:02.012996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:02.013646 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:02.019669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:02.021661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:02.021661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:02.021661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:02.022218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:02.022676 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:02.033973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:02.034668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:02.042616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:02.043111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:02.043850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:02.044558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:02.045016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:02.045446 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:02.175698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:02.183586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e9034da9-7f7c-40b4-aeb7-6eb41671a004 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.153748 Oct 04 05:44:02.184350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 84/165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:02 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:02.200444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:02.210437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e0b03688-3e4a-4473-baf9-5d3c6d3b40f6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.201287 Oct 04 05:44:02.211341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 82/166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:02 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:03.209046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:03.209655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:03.216550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.217150 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.217527 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.218250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.218696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.219114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.232991 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:03.235231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:03.244879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.245259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.245693 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.246426 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.246879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.247303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.432503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:03.443311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2e3ec946-8249-4e4f-9cbc-97d74f6b109c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.238699 Oct 04 05:44:03.444117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 85/167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:03 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:03.625701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:03.626224 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:03.634878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.635783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.636650 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.637474 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.638545 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.639442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.654271 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] HTTP exception thrown: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Request method failure captured: Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: DELETE /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c HTTP/1.1 Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8feU_EqcxIL78ZOL04GBfH_9b0FuRejHzTLu9GKntn-U9ZvLeuOE6muI6r_BdQd__VogDRVBiTai9VnZxiLKgRO5k2CmNCxn5ONSmTMlVCpqdbGRe5fvSM87AQVkvtk_R7rD6Zp4nhy0FXKyZxBsYROe8oAH9x6oXQvmvDKBLzBaJA Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:44:03.656825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b427232479e14a6fa576f4461032f12b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b427232479e14a6fa576f4461032f12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}] Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 9d1d5de04c894a2ab780bcdee15f5c5b Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.657983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '226a13ae-7a83-488a-9e42-7f524be2114c'} Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:44:03.658668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.660250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.662302 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Returning 404 to user: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:44:03.663526 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b389190d-dea7-4707-a027-a093781d622c tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 404 len: 111 microversion: 2.1 time: 0.041600 Oct 04 05:44:03.664231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 86/168] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:44:03 2022] DELETE /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:44:03.672190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:03.675672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:03.676465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] [instance: 226a13ae-7a83-488a-9e42-7f524be2114c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:03.680843 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9f60edb0-f854-48b6-b96f-0d260ab30df3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.451723 Oct 04 05:44:03.681636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 83/169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:03 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:03.696198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.696687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.697117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.697822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:03.698297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:03.698716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:03.715441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] HTTP exception thrown: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Request method failure captured: Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c HTTP/1.1 Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8feU_EqcxIL78ZOL04GBfH_9b0FuRejHzTLu9GKntn-U9ZvLeuOE6muI6r_BdQd__VogDRVBiTai9VnZxiLKgRO5k2CmNCxn5ONSmTMlVCpqdbGRe5fvSM87AQVkvtk_R7rD6Zp4nhy0FXKyZxBsYROe8oAH9x6oXQvmvDKBLzBaJA Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:44:03.716962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b427232479e14a6fa576f4461032f12b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b427232479e14a6fa576f4461032f12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b427232479e14a6fa576f4461032f12b"}]}] Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: b427232479e14a6fa576f4461032f12b Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-DeleteServersTestJSON-815403366 Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 9d1d5de04c894a2ab780bcdee15f5c5b Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-DeleteServersTestJSON-815403366-project Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.718058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '226a13ae-7a83-488a-9e42-7f524be2114c'} Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:44:03.726086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. Oct 04 05:44:03.727607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:44:03.728884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] Returning 404 to user: Instance 226a13ae-7a83-488a-9e42-7f524be2114c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:44:03.728884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-accec6fb-5591-4d4c-94bd-dc0798c27fa3 tempest-DeleteServersTestJSON-815403366 tempest-DeleteServersTestJSON-815403366-project] 10.222.0.26 "GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c" status: 404 len: 111 microversion: 2.1 time: 0.049869 Oct 04 05:44:03.728884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 87/170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:03 2022] GET /compute/v2.1/servers/226a13ae-7a83-488a-9e42-7f524be2114c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:44:04.277949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-38496a70-d3d2-46fb-98eb-5ba1b11aa4da req-b9792f0c-baed-4cd2-82e5-f001567c6907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdc3b68-5d3e-436c-974c-ca863a46af80", "tag": "14c00f98-c139-425e-822a-24588d96e045"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:04.290897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-38496a70-d3d2-46fb-98eb-5ba1b11aa4da req-b9792f0c-baed-4cd2-82e5-f001567c6907 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:04.291895 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-38496a70-d3d2-46fb-98eb-5ba1b11aa4da req-b9792f0c-baed-4cd2-82e5-f001567c6907 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:04.292703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-38496a70-d3d2-46fb-98eb-5ba1b11aa4da req-b9792f0c-baed-4cd2-82e5-f001567c6907 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:04.309815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-38496a70-d3d2-46fb-98eb-5ba1b11aa4da req-b9792f0c-baed-4cd2-82e5-f001567c6907 service nova] Creating event network-changed:14c00f98-c139-425e-822a-24588d96e045 for instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 on hv-cinder-84914 Oct 04 05:44:04.321387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-38496a70-d3d2-46fb-98eb-5ba1b11aa4da req-b9792f0c-baed-4cd2-82e5-f001567c6907 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044554 Oct 04 05:44:04.321387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 84/171] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:04.467475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:04.468149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:04.474819 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:04.475296 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:04.475729 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:04.476420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:04.476870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:04.477286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:04.704960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:04.706441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:04.712845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:04.713401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:04.713837 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:04.714557 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:04.715001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:04.715422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:04.756796 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:04.765127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4c1ce068-fa55-4dd6-a3a2-f51ef91bef2c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.301908 Oct 04 05:44:04.778621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 88/172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:04 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:04.782656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:04.855714 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:04.864109 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ec33face-d6e0-44e9-90d4-d93bafd3aed5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.163472 Oct 04 05:44:04.867164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 85/173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:04 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:05.789342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:05.790575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:05.793344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:05.809115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:05.811716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:05.814164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:05.815217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:05.816258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:05.818254 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:05.891261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:05.892889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:05.910798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:05.911549 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:05.916012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:05.917016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:05.918266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:05.924510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:06.118345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:06.127000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2cc406d8-c6ae-4bba-b48c-d438ba4b3b4c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.341469 Oct 04 05:44:06.128697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 89/174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:05 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:06.255925 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:06.267266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fc7ee413-8fe5-423f-9b58-64e20ae0bb50 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.381787 Oct 04 05:44:06.268799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 86/175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:05 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:07.150555 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:07.151128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:07.153003 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=12 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:07.157864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:07.158386 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:07.159423 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:07.160123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:07.160574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:07.161001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:07.179764 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:07.288801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=8 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:07.292875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:07.294481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:07.301329 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:07.315191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:07.315191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:07.315191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:07.315191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:07.315900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:07.405564 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:07.419479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c99bb0e4-a647-4d63-975d-1a832e6b4f63 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.268471 Oct 04 05:44:07.420121 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 90/176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:07 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:07.617227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:07.624836 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-71d31a6a-72d7-472e-93bb-70b0c60ccde7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.337044 Oct 04 05:44:07.625776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 87/177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:07 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:08.449621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:08.449621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:08.458371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:08.458888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:08.459324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:08.460021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:08.460469 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:08.460900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:08.594104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:08.602821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7e94560b-7d1e-4825-b76f-08d9800c540e tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.161062 Oct 04 05:44:08.603382 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 91/178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:08 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:08.649803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:08.650484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:08.657006 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:08.657508 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:08.657934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:08.659737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:08.660435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:08.665709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:08.836295 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:08.847219 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c43b6817-1797-4109-ba6a-ab1bcd777478 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.200717 Oct 04 05:44:08.848035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 88/179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:08 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:09.625303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:09.625908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:09.632651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:09.633128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:09.633562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:09.634285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:09.634739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:09.635241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:09.768515 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:09.777283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3c90e7e5-fd9d-488c-9043-67b32e0ce7ef tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.156158 Oct 04 05:44:09.777853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 92/180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:09 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:09.870224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:09.870962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:09.876922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:09.877418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:09.877901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:09.878578 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:09.879026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:09.879454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:10.041099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:10.044928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:10.049993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4a4312c7-842e-4e9f-907d-882872e7a4fb tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.183613 Oct 04 05:44:10.050753 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:09 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:10.800957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:10.801552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:10.810169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:10.810749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:10.811186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:10.812306 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:10.812768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:10.813197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:10.982852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:10.990908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7ef5ea7d-783a-40e5-8a58-c49ed5ddc0aa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.194338 Oct 04 05:44:10.991464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 93/182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:10 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:11.074402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:11.075242 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:11.081767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:11.082441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:11.083237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:11.084096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:11.084808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:11.085306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:11.225209 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:11.233197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-040eafa0-a93b-420e-8f44-3f0b2c75015b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.164318 Oct 04 05:44:11.233771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 90/183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:11 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:12.013502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:12.014214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:12.024017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:12.024643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:12.026114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:12.026947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:12.027509 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:12.027993 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:12.257342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:12.258649 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:12.265864 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:12.266648 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:12.267349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:12.268317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:12.268990 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:12.269618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:12.325235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:12.339509 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0c82c7c6-d49c-44e1-8ce0-e1eccbbfb1b9 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.329324 Oct 04 05:44:12.353897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 94/184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:12 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:12.407945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:12.417328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-91ab4b70-9875-48c2-aaaf-fbf16de64e82 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.163795 Oct 04 05:44:12.417905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 91/185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:12 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:13.363170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:13.363859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:13.375748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:13.376563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:13.377772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:13.379551 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:13.380232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:13.381421 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:13.446215 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:13.447729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:13.457604 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:13.458095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:13.462695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:13.463425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:13.463880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:13.464309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:13.663988 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:13.682338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3f4c1a41-929e-4a3e-8c29-84287679569c tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.240728 Oct 04 05:44:13.683461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 92/186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:13 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:13.781287 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:13.789625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9e549abf-1da1-4010-b3e0-cb0ecac5acc5 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.430286 Oct 04 05:44:13.816799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 95/187] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:13 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:14.709152 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:14.709992 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:14.716475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:14.717070 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:14.717736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:14.718921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:14.719618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:14.732397 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:14.814807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:14.816313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:14.828580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:14.829885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:14.843695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:14.843695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:14.843695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:14.843695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:14.946345 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:14.960425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0cb7672b-a82d-486a-9289-34f98ac90c43 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.255946 Oct 04 05:44:14.962529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 93/188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:14 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:15.201670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:15.201670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a00a92af-71fe-49bb-b8b8-a450b21d28bc tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.267745 Oct 04 05:44:15.201670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 96/189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:14 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:15.203170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-fcbd6a4c-3f0f-4b88-b28f-f2ebaebdb22f req-66c4124e-6797-440c-929b-7ad2d72cefb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdc3b68-5d3e-436c-974c-ca863a46af80", "name": "network-vif-plugged", "status": "completed", "tag": "14c00f98-c139-425e-822a-24588d96e045"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:15.203170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fcbd6a4c-3f0f-4b88-b28f-f2ebaebdb22f req-66c4124e-6797-440c-929b-7ad2d72cefb5 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:15.203170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fcbd6a4c-3f0f-4b88-b28f-f2ebaebdb22f req-66c4124e-6797-440c-929b-7ad2d72cefb5 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:15.203170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fcbd6a4c-3f0f-4b88-b28f-f2ebaebdb22f req-66c4124e-6797-440c-929b-7ad2d72cefb5 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:15.203657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-fcbd6a4c-3f0f-4b88-b28f-f2ebaebdb22f req-66c4124e-6797-440c-929b-7ad2d72cefb5 service nova] Creating event network-vif-plugged:14c00f98-c139-425e-822a-24588d96e045 for instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 on hv-cinder-84914 Oct 04 05:44:15.203657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-fcbd6a4c-3f0f-4b88-b28f-f2ebaebdb22f req-66c4124e-6797-440c-929b-7ad2d72cefb5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 Oct 04 05:44:15.203657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 94/190] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:15.983805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:15.984536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:15.991808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:15.992375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:15.993049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:15.993823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:15.994464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:15.995043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:16.104629 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:16.105332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:16.116545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:16.117045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:16.118350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:16.121065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:16.121548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:16.121989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:16.145175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:16.153795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7d9a932e-b9bd-4455-a1fc-40a72ca45c41 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.173808 Oct 04 05:44:16.166444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 97/191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:15 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:16.373403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:16.383661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-09f9dc3e-f4b0-4cac-9492-bdcb5947178b tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.284540 Oct 04 05:44:16.384793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 95/192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:16 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:17.177884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:17.185443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:17.185626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.186116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.186594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.187545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.188004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.190113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.246497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-765318999", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:17.311246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] validate_networks() for [('4e58183d-6dc3-4dfa-97e6-588eb4bec1b8', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:44:17.414875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:17.424704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b12ac990-b454-4a9f-8071-a3967025cfb3 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1319 microversion: 2.1 time: 0.251373 Oct 04 05:44:17.425399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 96/193] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:17 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:17.430113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-0e120158-9c28-4b32-96e1-bda6a7257335 req-8e9fb6f2-25ce-4652-b516-5077562de6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32012bae-aedb-43a2-b9fd-51dae912067e", "name": "network-vif-plugged", "status": "completed", "tag": "0c4a70b8-b109-41f3-b954-ceb15a1901e0"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:17.442202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0e120158-9c28-4b32-96e1-bda6a7257335 req-8e9fb6f2-25ce-4652-b516-5077562de6e2 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.442973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0e120158-9c28-4b32-96e1-bda6a7257335 req-8e9fb6f2-25ce-4652-b516-5077562de6e2 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.443479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0e120158-9c28-4b32-96e1-bda6a7257335 req-8e9fb6f2-25ce-4652-b516-5077562de6e2 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.455945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-0e120158-9c28-4b32-96e1-bda6a7257335 req-8e9fb6f2-25ce-4652-b516-5077562de6e2 service nova] Creating event network-vif-plugged:0c4a70b8-b109-41f3-b954-ceb15a1901e0 for instance 32012bae-aedb-43a2-b9fd-51dae912067e on hv-cinder-84914 Oct 04 05:44:17.461210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-0e120158-9c28-4b32-96e1-bda6a7257335 req-8e9fb6f2-25ce-4652-b516-5077562de6e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 Oct 04 05:44:17.461892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 97/194] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:17.469024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:17.470182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:17.476892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.477647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.478337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.479294 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.480086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.480696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.673179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:17.683302 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-415e2a53-f7b2-491f-b92c-481999863bd8 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.219643 Oct 04 05:44:17.687699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 98/195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:17 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:17.935353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:44:17.935776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:44:17.937287 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:44:17.937775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:44:17.938263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:44:17.947452 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.947933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.948370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.949092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:17.949546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:17.950037 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:17.966991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for project 689c4759cb5943b79f2637a8e29e230e. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:44:17.971578 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for user c1b48a973c20470a9af23c77e3da5b72 and project 689c4759cb5943b79f2637a8e29e230e. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:44:17.985855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:44:17.989099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:44:18.006797 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:18.146951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b2d0d09e-93f1-4aeb-83bd-fd342002568b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.038284 Oct 04 05:44:18.160481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b79d824f-ac92-412b-bd8c-3bf5ea2ebd8b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:18.161098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b79d824f-ac92-412b-bd8c-3bf5ea2ebd8b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:18.165342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 98/196] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:44:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 05:44:18.225436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b79d824f-ac92-412b-bd8c-3bf5ea2ebd8b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:18.243389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b79d824f-ac92-412b-bd8c-3bf5ea2ebd8b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1221 microversion: 2.1 time: 0.088317 Oct 04 05:44:18.244017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 99/197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:18 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:18.385819 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1902269608", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:18.449783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:18.457723 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:18.462046 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:18.462569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:18.469246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] validate_networks() for [('4e58183d-6dc3-4dfa-97e6-588eb4bec1b8', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:44:18.475044 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:18.476166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:18.476694 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:18.477134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:18.682086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:18.698447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c0463d75-81e7-4bf7-8017-a5ac4cac1396 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1507 microversion: 2.1 time: 0.248413 Oct 04 05:44:18.698447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 100/198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:18 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:18.712859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:18.719090 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:18.731664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:18.732156 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:18.733262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:18.733965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:18.734443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:18.734867 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:18.998843 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:19.010577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dc593525-2cb1-4e05-9b19-eeb2d0dfeb24 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1315 microversion: 2.1 time: 0.305439 Oct 04 05:44:19.011366 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 101/199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:18 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:19.137823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:44:19.138277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:44:19.138835 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:44:19.139403 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:44:19.140004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:44:19.152243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:19.153071 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:19.153665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:19.154882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:19.155515 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:19.156910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:19.179338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for project 689c4759cb5943b79f2637a8e29e230e. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:44:19.183296 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for user c1b48a973c20470a9af23c77e3da5b72 and project 689c4759cb5943b79f2637a8e29e230e. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:44:19.195160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:44:19.200681 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:44:19.393362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9e3f0404-9cc3-4ff7-9e9e-c8c831679892 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.008275 Oct 04 05:44:19.394440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 99/200] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:44:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:44:19.406842 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-02ddcf4b-87e7-4a9f-a2ae-da262a9d6775 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:19.407609 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-02ddcf4b-87e7-4a9f-a2ae-da262a9d6775 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:19.485306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-02ddcf4b-87e7-4a9f-a2ae-da262a9d6775 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:19.493424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-02ddcf4b-87e7-4a9f-a2ae-da262a9d6775 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1222 microversion: 2.1 time: 0.091403 Oct 04 05:44:19.495794 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 102/201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:19 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:20.037884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:20.038818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:20.046472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:20.047132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:20.047736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:20.048676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:20.049274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:20.049854 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:20.279546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:20.312611 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-66ad3155-6548-4486-806b-059aa09f997c tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1465 microversion: 2.1 time: 0.281327 Oct 04 05:44:20.326883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 100/202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:20 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1465 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:20.362164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:20.362967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:20.377706 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:20.384246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:20.384246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:20.384246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:20.384246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:20.385214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:20.418637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:44:20.517237 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c7c5d810-d503-4aba-a2d1-08d84512d477 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:20.519321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c7c5d810-d503-4aba-a2d1-08d84512d477 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:20.582773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c7c5d810-d503-4aba-a2d1-08d84512d477 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:20.590088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c7c5d810-d503-4aba-a2d1-08d84512d477 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1222 microversion: 2.1 time: 0.076543 Oct 04 05:44:20.590694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 101/203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:20 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:20.912957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6edb1d9a-e644-4419-91f0-36b6c6341e1f tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "DELETE /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 204 len: 0 microversion: 2.1 time: 0.554787 Oct 04 05:44:20.914628 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 103/204] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:44:20 2022] DELETE /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:44:20.922310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:20.923276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:20.931638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:20.932448 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:20.933053 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:20.933801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:20.934479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:20.937615 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:21.113912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:21.122955 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-31563ce3-fd76-4257-9f0f-18718baad9d1 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1471 microversion: 2.1 time: 0.204777 Oct 04 05:44:21.124120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 102/205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:20 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:21.613101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:21.613953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:21.623788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:21.626255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:21.627752 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:21.628724 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:21.630973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:21.633282 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:21.742959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:21.752899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f42a25e0-2152-47e6-bea0-1b481cfeeb45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1226 microversion: 2.1 time: 0.143894 Oct 04 05:44:21.766726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 104/206] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:21 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:21.810165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:21.810894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:21.818581 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:21.819083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:21.819712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:21.820842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:21.821297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:21.821740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:21.859284 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-81c22942-5396-46d2-ad0c-e1a9714ddded tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/ips" status: 200 len: 150 microversion: 2.1 time: 0.052109 Oct 04 05:44:21.866983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 103/207] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:44:21 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/ips => generated 150 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:22.148428 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:22.149032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:22.153157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:22.159967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:22.159967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:22.159967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:22.160610 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:22.161223 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:22.161937 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:22.320202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:22.326707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-91bb3912-232d-45e0-a9ff-8ea490e76337 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1471 microversion: 2.1 time: 0.182153 Oct 04 05:44:22.327283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 105/208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:22 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:22.780116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:22.780989 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:22.808889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:22.809489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:22.810645 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:22.811374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:22.812137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:22.812753 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:22.897520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:22.905313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-78d8f5da-4ce2-4dca-8031-42baa777a9db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1218 microversion: 2.1 time: 0.129574 Oct 04 05:44:22.905862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 104/209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:22 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:23.352625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:23.353942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:23.366289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.368510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.369125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.370757 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.381712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.382184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.414548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:23.417328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:23.447965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.448719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.449349 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.450844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.451461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.452477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.528872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d9a6317f-a43b-4679-8a78-4084141ba5c9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/ips" status: 200 len: 144 microversion: 2.1 time: 0.118298 Oct 04 05:44:23.529634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 105/210] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:44:23 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/ips => generated 144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:23.559819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:23.559944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-6300d758-5394-4a63-8fb9-7b018ff6dab3 req-3371a337-a6a7-4e4e-b499-de2977ff6f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32012bae-aedb-43a2-b9fd-51dae912067e", "name": "network-vif-deleted", "tag": "0c4a70b8-b109-41f3-b954-ceb15a1901e0"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:23.563763 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e1d9f2f5-509b-4655-923c-538716cc35fa tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1429 microversion: 2.1 time: 0.215338 Oct 04 05:44:23.564782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 106/211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:23 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:23.575369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-6300d758-5394-4a63-8fb9-7b018ff6dab3 req-3371a337-a6a7-4e4e-b499-de2977ff6f34 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.576281 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-6300d758-5394-4a63-8fb9-7b018ff6dab3 req-3371a337-a6a7-4e4e-b499-de2977ff6f34 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.576960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-6300d758-5394-4a63-8fb9-7b018ff6dab3 req-3371a337-a6a7-4e4e-b499-de2977ff6f34 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.591178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-6300d758-5394-4a63-8fb9-7b018ff6dab3 req-3371a337-a6a7-4e4e-b499-de2977ff6f34 service nova] Creating event network-vif-deleted:0c4a70b8-b109-41f3-b954-ceb15a1901e0 for instance 32012bae-aedb-43a2-b9fd-51dae912067e on hv-cinder-84914 Oct 04 05:44:23.597601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-6300d758-5394-4a63-8fb9-7b018ff6dab3 req-3371a337-a6a7-4e4e-b499-de2977ff6f34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053675 Oct 04 05:44:23.598220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 106/212] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:23.834625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3b3e25-5167-422c-87d0-f24fc3285750"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:23.843166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:23.861628 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.865010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.865010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.868780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.869404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.875515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.929874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:23.930471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:23.962181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.970992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.974793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:23.974793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:23.975482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:23.977970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:24.093207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:24.101631 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e2f66f29-6a7c-44b2-8efe-4433ad05fb40 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1274 microversion: 2.1 time: 0.176530 Oct 04 05:44:24.102232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 107/213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:23 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:24.588094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:24.588705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:24.600678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:24.601518 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:24.602106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:24.604112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:24.604563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:24.605356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:24.645396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:24.647075 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:24.647988 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:24.648643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lazy-loading 'fault' on Instance uuid 32012bae-aedb-43a2-b9fd-51dae912067e {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:44:24.695292 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:24.703813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:24.722251 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4389af73-31c3-41ca-b7a9-bb362e41cbf0 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1305 microversion: 2.1 time: 0.137200 Oct 04 05:44:24.723442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 108/214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:24 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:25.071297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:25.072616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:25.083646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.086534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.090405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.090405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.090405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.090405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.132674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-80bfd774-64b0-42eb-840b-d5445ecc8113 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/ips" status: 200 len: 152 microversion: 2.20 time: 0.065166 Oct 04 05:44:25.133801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 109/215] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Oct 4 05:44:25 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/ips => generated 152 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 05:44:25.146438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:25.147040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:25.154178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.154781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.155494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.159435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.159435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.159435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.246906 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:25.250789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:25.258656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7a294315-c2f6-48fe-bbcb-e4c0ac408292 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1292 microversion: 2.1 time: 0.123631 Oct 04 05:44:25.260310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 110/216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:25 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1292 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:25.371633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d71d3ff5-e3e3-4a87-9b3e-1b94c231a7db tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.542343 Oct 04 05:44:25.378356 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 107/217] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:44:23 2022] POST /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 194 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:25.756297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:25.760791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:25.768005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.768576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.769071 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.769883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.770572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.771141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.812596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:25.814379 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:25.814823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:25.815272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lazy-loading 'fault' on Instance uuid 32012bae-aedb-43a2-b9fd-51dae912067e {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:44:25.874056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc251db5cf4e24a3fc8ffab6e9b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318c2ab91f564d8ba2e29b724c008dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:25.884590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-112f7194-7177-4f0b-9070-fb82343c88bb tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 200 len: 1305 microversion: 2.1 time: 0.132531 Oct 04 05:44:25.885713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 111/218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:25 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:26.289923 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:26.290913 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:26.298048 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:26.299400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:26.301650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:26.301650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:26.301650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:26.301650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:26.384181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:26.397310 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-224e9f86-e672-4182-a58d-9e1a73594378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1280 microversion: 2.1 time: 0.112911 Oct 04 05:44:26.402177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 108/219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:26 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:26.714351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-29a0c1cc-cc32-4bab-8685-1b8b6fc55806 req-74e0eec1-e98a-4062-ab9b-b7648e366e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27eb826-a49d-4d1d-a843-cc725fae592b", "tag": "1c9ceaa0-2adc-4ea7-892e-2a41d1c48287"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:26.732763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-29a0c1cc-cc32-4bab-8685-1b8b6fc55806 req-74e0eec1-e98a-4062-ab9b-b7648e366e39 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:26.732763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-29a0c1cc-cc32-4bab-8685-1b8b6fc55806 req-74e0eec1-e98a-4062-ab9b-b7648e366e39 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:26.732763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-29a0c1cc-cc32-4bab-8685-1b8b6fc55806 req-74e0eec1-e98a-4062-ab9b-b7648e366e39 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:26.759278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-29a0c1cc-cc32-4bab-8685-1b8b6fc55806 req-74e0eec1-e98a-4062-ab9b-b7648e366e39 service nova] Creating event network-changed:1c9ceaa0-2adc-4ea7-892e-2a41d1c48287 for instance f27eb826-a49d-4d1d-a843-cc725fae592b on hv-cinder-84914 Oct 04 05:44:26.771192 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-29a0c1cc-cc32-4bab-8685-1b8b6fc55806 req-74e0eec1-e98a-4062-ab9b-b7648e366e39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058937 Oct 04 05:44:26.771859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 112/220] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:26.909134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:26.910037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] [instance: 32012bae-aedb-43a2-b9fd-51dae912067e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:26.918005 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:26.918777 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:26.920148 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:26.920148 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:26.920588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:26.921196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:26.950409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] HTTP exception thrown: Instance 32012bae-aedb-43a2-b9fd-51dae912067e could not be found. Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Request method failure captured: Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e HTTP/1.1 Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8gW2cW24CFFFCGCPkSIxGFT17lg-U7M5uhHbRiR98KhLycuDsqXFZhMF9QbRvBI4-0P0m1yWKBNVjsLyRS80d71crW5MTRKw1pbhvBKUizB0cv3SGRi_K20kHpjL8N39qSpbXVel1NJ3hi6_ThVS1GFO1-QYhInlzwQbDzBVCzUII4 Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 318c2ab91f564d8ba2e29b724c008dbc Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesNegativeTest-1354469047 Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:44:26.952385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_318c2ab91f564d8ba2e29b724c008dbc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/318c2ab91f564d8ba2e29b724c008dbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/318c2ab91f564d8ba2e29b724c008dbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/318c2ab91f564d8ba2e29b724c008dbc"}]}] Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesNegativeTest-1354469047 Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 318c2ab91f564d8ba2e29b724c008dbc Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesNegativeTest-1354469047 Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesNegativeTest-1354469047-project Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: cadc251db5cf4e24a3fc8ffab6e9b9ae Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesNegativeTest-1354469047-project Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 32012bae-aedb-43a2-b9fd-51dae912067e could not be found. Oct 04 05:44:26.953846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '32012bae-aedb-43a2-b9fd-51dae912067e'} Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32012bae-aedb-43a2-b9fd-51dae912067e could not be found. Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:44:26.955744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32012bae-aedb-43a2-b9fd-51dae912067e could not be found. Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32012bae-aedb-43a2-b9fd-51dae912067e could not be found. Oct 04 05:44:26.957146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:44:26.959010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] Returning 404 to user: Instance 32012bae-aedb-43a2-b9fd-51dae912067e could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:44:26.959154 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a5f09418-6b46-4e97-8c35-8b7bc6f1a539 tempest-VolumesNegativeTest-1354469047 tempest-VolumesNegativeTest-1354469047-project] 10.222.0.26 "GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e" status: 404 len: 111 microversion: 2.1 time: 0.054140 Oct 04 05:44:26.960110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 109/221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:26 2022] GET /compute/v2.1/servers/32012bae-aedb-43a2-b9fd-51dae912067e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:44:27.421649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:27.422178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:27.430265 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:27.430755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:27.432053 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:27.432161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:27.432735 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:27.433167 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:27.632899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:27.646894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5fe15bf4-5a9d-4f93-85bb-f854317ccb10 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.229585 Oct 04 05:44:27.649258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 113/222] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:27 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:28.672524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:28.673115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:28.681295 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:28.681782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:28.682254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:28.682951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:28.683402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:28.683826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:28.806252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-762718e7-9da0-40ff-a51a-25a9614f7db9 req-14cf21eb-95f3-4fdd-8363-18ca36644c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b22d78-62a0-4440-8cae-c8e5b37e99fa", "tag": "e6548b2f-6183-4b2b-aebf-1a0952863241"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:28.817934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-762718e7-9da0-40ff-a51a-25a9614f7db9 req-14cf21eb-95f3-4fdd-8363-18ca36644c66 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:28.818969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-762718e7-9da0-40ff-a51a-25a9614f7db9 req-14cf21eb-95f3-4fdd-8363-18ca36644c66 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:28.819592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-762718e7-9da0-40ff-a51a-25a9614f7db9 req-14cf21eb-95f3-4fdd-8363-18ca36644c66 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:28.834587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-762718e7-9da0-40ff-a51a-25a9614f7db9 req-14cf21eb-95f3-4fdd-8363-18ca36644c66 service nova] Creating event network-changed:e6548b2f-6183-4b2b-aebf-1a0952863241 for instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa on hv-cinder-84914 Oct 04 05:44:28.834800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:28.843495 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-762718e7-9da0-40ff-a51a-25a9614f7db9 req-14cf21eb-95f3-4fdd-8363-18ca36644c66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041447 Oct 04 05:44:28.844092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 114/223] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:28.857608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3418e16f-fc0f-4b70-bae0-e6b33ce739a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.184097 Oct 04 05:44:28.857608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:28 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:29.354901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:29.355553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:29.357629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=4 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:29.363157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:29.363641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:29.364080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:29.364763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:29.365279 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:29.365707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:29.389874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'flavor' on Instance uuid 73d72dc7-af42-4950-b7c2-3d617f22680c {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:44:29.689899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a14f4d0c-83e9-486f-933d-119984f58f59"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:29.692387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:29.694470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:29.699739 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:29.700313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:29.700753 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:29.701615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:29.702064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:29.703243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:30.528233 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fad3f799-7140-43fe-9233-051346c6dc7b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/action" status: 202 len: 0 microversion: 2.20 time: 1.177533 Oct 04 05:44:30.528867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 115/225] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 05:44:29 2022] POST /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/action => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:44:30.533926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:30.534982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:30.542175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:30.542644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:30.543076 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:30.543769 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:30.544219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:30.544638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:30.586818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=14 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:30.695626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:30.702205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3f9860ae-032d-4356-9dc0-ec9d0d512fe6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.172027 Oct 04 05:44:30.703155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 116/226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:30 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:30.708181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:30.708770 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:30.714780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:30.715251 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:30.715687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:30.716389 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:30.716831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:30.717253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:30.871308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:30.880690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:30.885897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:30.885897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-da0c2059-0991-474d-87ab-ad45e30ccd51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.178945 Oct 04 05:44:30.885897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 117/227] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:30 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:31.727680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:31.729257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:31.736491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:31.737405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:31.737875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:31.738846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:31.739330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:31.740116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:32.043382 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:32.051683 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d1cadfa3-ee85-4396-b869-855a52d67fd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.327897 Oct 04 05:44:32.052353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 118/228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:31 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:32.058625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:32.059507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:32.066347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:32.066842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:32.067282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:32.067975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:32.068425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:32.068849 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:32.239962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:32.249452 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:32.251121 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:32.252387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-27bfa15a-dbf6-415f-afad-283bc615e940 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.197858 Oct 04 05:44:32.253107 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 119/229] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:32 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:33.078874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:33.081367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:33.091939 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:33.092425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:33.093077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:33.093950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:33.094576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:33.095181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:33.297257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-01cb9efa-1243-4fa2-b920-177a3d336f85 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.611447 Oct 04 05:44:33.302833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 111/230] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:44:29 2022] POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-volume_attachments => generated 194 bytes in 3618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:44:33.320389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:33.322288 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:33.336199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:33.336852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:33.337747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:33.339809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:33.340296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:33.340726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:33.372726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:33.379468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a2216fd6-c159-41ec-ad7f-4f8b4bc8ef52 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.304137 Oct 04 05:44:33.380551 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 120/231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:33 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:33.525989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:33.537139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:33.539452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:33.550496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7f83dca0-06d2-4d81-b77e-a38881e81a73 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.234354 Oct 04 05:44:33.554460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 112/232] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:33 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:34.424238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:34.424901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:34.432301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:34.432859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:34.433099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-768e691b-c964-4b21-ae50-54d928576e7b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: .version_select at 0x7f04866ea9d0>, body: {"keypair": {"name": "tempest-keypair-2021383007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe6X6p+FMKEFcmqnH+an6f6u0Vvkc7WRebPzxefUaFncFfgH5W7rZsFBE7GcN8zTxhZ4OVBEhfsG3JIGZioPDP6MlBi6B9DVpSpBZ/OSe2msdHd/PEwifEBAZ+gS2/e8A=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:34.433616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:34.434029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:34.435460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:34.436040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:34.453441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-768e691b-c964-4b21-ae50-54d928576e7b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:44:34.461241 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-768e691b-c964-4b21-ae50-54d928576e7b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:44:34.585212 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-768e691b-c964-4b21-ae50-54d928576e7b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158411 Oct 04 05:44:34.585840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 113/233] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:44:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:44:34.590894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:34.591685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:34.599343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:34.600878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:34.600878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:34.601364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:34.601961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:34.602578 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:34.615966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:34.628284 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9a8ed7ad-7ee4-4680-8aa9-3163751082ea tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.218758 Oct 04 05:44:34.628892 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 121/234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:34 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:34.800672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:34.813526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:34.814954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:34.816117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e5826a6c-05f3-479b-93fe-1ddc4d3453d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.228982 Oct 04 05:44:34.816669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 114/235] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:34 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:35.656381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:35.656991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:35.666226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:35.666710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:35.667589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:35.671544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:35.672016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:35.672454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:35.807214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:35.816563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ec5a3fdf-c236-45a6-a7f4-9601285a5e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.163860 Oct 04 05:44:35.831519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 122/236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:35 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:35.840698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:35.841486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:35.848249 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:35.848738 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:35.849165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:35.850022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:35.850501 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:35.850922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:36.057027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:36.066589 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:36.068860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:36.070009 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-91a258df-c5af-46f5-8956-b1df23320dfc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.233158 Oct 04 05:44:36.070755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 115/237] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:35 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:36.843955 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:36.844677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:36.851985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:36.852641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:36.853216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:36.854179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:36.854789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:36.855227 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:37.013523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:37.022368 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7ac3552d-25ba-4d84-a906-5db111293027 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.184528 Oct 04 05:44:37.022942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 123/238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:36 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:37.096181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:37.096787 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:37.107224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:37.112720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:37.112720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:37.112720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:37.112720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:37.113024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:37.150120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-fc538519-279a-4b6d-ae20-e708fdec1c0e req-0d80ccc7-abf1-4ef2-9c0e-45e2b4067470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27eb826-a49d-4d1d-a843-cc725fae592b", "name": "network-vif-plugged", "status": "completed", "tag": "1c9ceaa0-2adc-4ea7-892e-2a41d1c48287"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:37.160926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-fc538519-279a-4b6d-ae20-e708fdec1c0e req-0d80ccc7-abf1-4ef2-9c0e-45e2b4067470 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:37.161394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-fc538519-279a-4b6d-ae20-e708fdec1c0e req-0d80ccc7-abf1-4ef2-9c0e-45e2b4067470 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:37.161816 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-fc538519-279a-4b6d-ae20-e708fdec1c0e req-0d80ccc7-abf1-4ef2-9c0e-45e2b4067470 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:37.175401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-fc538519-279a-4b6d-ae20-e708fdec1c0e req-0d80ccc7-abf1-4ef2-9c0e-45e2b4067470 service nova] Creating event network-vif-plugged:1c9ceaa0-2adc-4ea7-892e-2a41d1c48287 for instance f27eb826-a49d-4d1d-a843-cc725fae592b on hv-cinder-84914 Oct 04 05:44:37.180967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-fc538519-279a-4b6d-ae20-e708fdec1c0e req-0d80ccc7-abf1-4ef2-9c0e-45e2b4067470 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 Oct 04 05:44:37.181550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 124/239] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:44:37.278825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:37.287417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:37.288942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:37.290294 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f9f5c654-99da-422e-a413-32591ce4ec08 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.197917 Oct 04 05:44:37.290905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 116/240] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:37 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:37.345881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-122705101", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c58c152-65b4-475d-9100-474584bb25cf"}], "security_groups": [{"name": "tempest-securitygroup--1970810997"}], "key_name": "tempest-keypair-2021383007", "user_data": "}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:37.452636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] validate_networks() for [('2c58c152-65b4-475d-9100-474584bb25cf', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:44:38.044695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:38.045285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:38.053986 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:44:38.054504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:44:38.055532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:44:38.055644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:44:38.056050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:38.056193 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:44:38.056816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:38.057501 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:38.058443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:38.058896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:38.064213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:38.067739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:38.068331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:38.068939 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:38.070866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:38.071402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:38.071943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:38.119955 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:44:38.124810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:44:38.137750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:44:38.140968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:44:38.211164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:38.219268 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fdcb9c1d-2650-48a1-8a82-d2b27c6edfc2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.178391 Oct 04 05:44:38.220272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 117/241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:38 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:38.256488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6f15b138-5ba8-4f4d-8ddf-8567bc2c43e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.915083 Oct 04 05:44:38.257213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 125/242] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:44:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:44:38.268613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7eb83198-be36-491d-9e26-6cfc2b3a2cee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:38.269237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7eb83198-be36-491d-9e26-6cfc2b3a2cee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:38.316054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:38.316696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:38.325633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:38.330749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:38.330749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:38.330749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:38.330749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:38.331071 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:38.359961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7eb83198-be36-491d-9e26-6cfc2b3a2cee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:38.367812 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7eb83198-be36-491d-9e26-6cfc2b3a2cee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1241 microversion: 2.1 time: 0.102937 Oct 04 05:44:38.368380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 118/243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:38 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:38.496197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:38.505049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:38.506531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:38.507681 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7c3e9cec-edd7-4201-98af-ad0843d7c255 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.195955 Oct 04 05:44:38.508230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 126/244] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:38 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:44:39.245001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:39.245676 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:39.251893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:39.252372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:39.252800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:39.253490 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:39.253938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:39.254389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:39.390400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:39.393200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:39.393861 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:39.399124 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4ae8510c-a1ad-447a-9e1b-16eb3e56225b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.158104 Oct 04 05:44:39.404733 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 119/245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:39 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:39.406360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:39.406855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:39.407347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:39.408051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:39.408703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:39.409135 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:39.474703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:39.478220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:39.483092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-279474ab-7641-4ac3-8549-9fa20dd156b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1245 microversion: 2.1 time: 0.093909 Oct 04 05:44:39.483645 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 127/246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:39 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:39.532841 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:39.533390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:39.539306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:39.539774 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:39.540201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:39.540895 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:39.541336 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:39.541748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:39.671407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:39.679752 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:39.681228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:39.682425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1ce718e8-4a38-41b3-9e4c-73f6b184feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.153560 Oct 04 05:44:39.682992 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 120/247] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:39 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:40.420999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:40.421603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:40.428935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:40.429415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:40.429846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:40.430562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:40.431005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:40.431424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:40.507837 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:40.508557 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:40.515029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:40.515505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:40.515940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:40.516624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:40.517068 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:40.517489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:40.561417 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:40.569560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c7b79318-2210-444e-a607-5021fa465dc1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.152682 Oct 04 05:44:40.570389 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 128/248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:40 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:40.601649 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:40.610391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f1623bbf-5599-4399-8f99-a9efcbf92f3e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1245 microversion: 2.1 time: 0.106390 Oct 04 05:44:40.616003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 121/249] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:40 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:40.709078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:40.709679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:40.713131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:40.717012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:40.717486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:40.717917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:40.718634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:40.719087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:40.719522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:40.877187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:40.885839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:40.887375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:40.888603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0d135187-49e3-41b1-8f2e-a7354a744480 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.184134 Oct 04 05:44:40.889155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 129/250] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:40 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:41.592281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:41.592876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:41.600384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:41.600710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:41.601330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:41.602092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:41.602603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:41.603033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:41.633289 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:41.633898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:41.641773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:41.642292 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:41.648257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:41.648257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:41.648257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:41.648257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:41.706285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:41.714823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bb267d96-1922-423f-abd3-254bfa18313c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1245 microversion: 2.1 time: 0.085773 Oct 04 05:44:41.715566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 130/251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:41 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:41.793041 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:41.800966 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f4eea8df-5290-4274-9742-bda0cde17e5b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.212728 Oct 04 05:44:41.802293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 122/252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:41 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:41.916444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:41.917848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:41.927089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:41.927650 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:41.928106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:41.928818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:41.929280 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:41.929712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:42.085244 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:42.093470 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:42.095061 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:42.096216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d92560e8-4952-4a52-9d3d-8d851d3ddaa5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.184152 Oct 04 05:44:42.096776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 131/253] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:41 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:42.737562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:42.738182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:42.745180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:42.745824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:42.746596 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:42.747318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:42.747765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:42.748183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:42.816256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:42.823887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:42.824494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:42.824673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bf2b7859-bff8-44ff-b8f5-6210e1b442f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1245 microversion: 2.1 time: 0.090953 Oct 04 05:44:42.825250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 123/254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:42 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:42.831254 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:42.831768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:42.833008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:42.833707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:42.834203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:42.834640 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:42.981895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:42.990940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d5bb51e8-a92d-43f4-a967-06ff2715e378 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.170879 Oct 04 05:44:42.991804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 132/255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:42 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:43.131960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:43.132746 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:43.140908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:43.141587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:43.142513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:43.143371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:43.144137 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:43.144718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:43.282987 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:43.287100 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:43.292174 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:43.293610 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:43.294783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2d646a92-10be-4f64-95cb-3b3a08ecd6cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.168514 Oct 04 05:44:43.295338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 124/256] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:43 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:43.852158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:43.852770 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:43.859210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:43.859685 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:43.860117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:43.860793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:43.861236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:43.861700 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:43.925461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:43.933089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8dbac272-705f-41c2-bd98-56e4a4505fb7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1237 microversion: 2.1 time: 0.085549 Oct 04 05:44:43.933651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 133/257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:43 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:44.015092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:44.015811 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:44.023817 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:44.024786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:44.025273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:44.026184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:44.026638 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:44.027062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:44.222745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:44.230338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-15f45094-36b9-4201-afc1-1359f19db677 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.219679 Oct 04 05:44:44.230900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 125/258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:44 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:44.321494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:44.322095 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:44.327962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:44.328444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:44.328877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:44.329560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:44.330010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:44.330463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:44.455766 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:44.463814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:44.465263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:44.466463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-662bcb73-f8ba-4812-a622-3ea61007e5d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.149523 Oct 04 05:44:44.467022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 134/259] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:44 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:44.956919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:44.957527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:44.963712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:44.964195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:44.964630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:44.965319 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:44.965762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:44.966217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:45.025792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:45.033290 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d4e584bb-fe8c-499e-969a-7593da7996df tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1293 microversion: 2.1 time: 0.080234 Oct 04 05:44:45.033858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 126/260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:44 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:45.252781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:45.253392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:45.259742 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:45.260226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:45.260666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:45.261353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:45.261807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:45.262322 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:45.389249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:45.397274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-41d3e415-06d0-4732-b148-8f02639c8e9f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.148370 Oct 04 05:44:45.397830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 135/261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:45 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:45.491161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:45.491739 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:45.497799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:45.498323 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:45.498759 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:45.499443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:45.499924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:45.500345 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:45.621881 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:45.630303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:45.631758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:45.632894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-59c3f8cf-b074-4dcc-8de2-f6f1d07a58a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.145706 Oct 04 05:44:45.633461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 127/262] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:45 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:46.056949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:46.057483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:46.063850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:46.064326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:46.064754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:46.065626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:46.066086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:46.067174 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:46.130875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:46.138475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-140ab755-22df-40a5-9ad9-34697aaf8ec4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1293 microversion: 2.1 time: 0.085410 Oct 04 05:44:46.139034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 136/263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:46 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:46.419806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:46.420404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:46.427381 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:46.427860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:46.428291 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:46.428976 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:46.429423 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:46.429842 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:46.557891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:46.565812 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b1ad41da-57e1-4e71-86e3-3feb9e724cde tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.149737 Oct 04 05:44:46.566367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 128/264] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:46 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:46.658212 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:46.658823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:46.665911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:46.666431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:46.666872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:46.667562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:46.668014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:46.668578 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:46.793698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:46.801894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:46.803517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:46.804668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-062275ee-9db2-4011-bb72-113268250d02 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.150408 Oct 04 05:44:46.805217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 137/265] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:46 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:47.160791 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:47.162174 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:47.168473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.169176 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.169670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.170575 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.171239 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.171863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.455668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:47.466808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-abbef045-bab9-46c6-9283-f87b1345860c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1293 microversion: 2.1 time: 0.309831 Oct 04 05:44:47.467402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 129/266] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:47 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1293 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:47.520370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-3445725e-7e52-44cc-bba1-db024f2d7fcf req-58a865b8-c4f8-4e00-b2b8-65145fdc9dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b22d78-62a0-4440-8cae-c8e5b37e99fa", "name": "network-vif-plugged", "status": "completed", "tag": "e6548b2f-6183-4b2b-aebf-1a0952863241"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:47.529996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3445725e-7e52-44cc-bba1-db024f2d7fcf req-58a865b8-c4f8-4e00-b2b8-65145fdc9dcd service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.530871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3445725e-7e52-44cc-bba1-db024f2d7fcf req-58a865b8-c4f8-4e00-b2b8-65145fdc9dcd service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.530971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3445725e-7e52-44cc-bba1-db024f2d7fcf req-58a865b8-c4f8-4e00-b2b8-65145fdc9dcd service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.543671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-3445725e-7e52-44cc-bba1-db024f2d7fcf req-58a865b8-c4f8-4e00-b2b8-65145fdc9dcd service nova] Creating event network-vif-plugged:e6548b2f-6183-4b2b-aebf-1a0952863241 for instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa on hv-cinder-84914 Oct 04 05:44:47.548962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-3445725e-7e52-44cc-bba1-db024f2d7fcf req-58a865b8-c4f8-4e00-b2b8-65145fdc9dcd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032778 Oct 04 05:44:47.549598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 138/267] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:44:47.588495 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:47.589123 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:47.595157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.595637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.596188 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.596869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.597313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.597734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.761993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:47.771336 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-84127e64-c8f8-482f-a1b4-106550c2bc51 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.186665 Oct 04 05:44:47.771990 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 130/268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:47 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:47.830921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:47.831882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:47.838786 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.839378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.840060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.848680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:47.849349 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:47.849788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:47.989308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:47.997741 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:47.999239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:48.000472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b3a7bb45-c75f-43a9-99dc-ca3edc63580d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.174457 Oct 04 05:44:48.001199 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 139/269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:47 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:48.489945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:48.490583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:48.492564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=6 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:48.497754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:48.498258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:48.498698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:48.499377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:48.499823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:48.500251 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:48.635891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:48.647492 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f57b726d-1d08-4103-a593-34ef8882128b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1301 microversion: 2.1 time: 0.161177 Oct 04 05:44:48.648077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 131/270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:48 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:48.795133 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:48.795779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:48.797786 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:48.798481 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:48.803323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:48.803885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:48.804312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:48.805070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:48.805526 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:48.805956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:48.934347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:48.943394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-53f1c1a6-f04a-47cf-ab55-21a55c6ab604 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.152157 Oct 04 05:44:48.943950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 140/271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:48 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:49.026654 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:49.027254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:49.033299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.033775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.034235 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.034927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.035393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.035817 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.167037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:49.175228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:49.177226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:49.178487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-758d8090-3b10-4433-bd31-0bb230d5fe2c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.155761 Oct 04 05:44:49.179051 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 132/272] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:49 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:49.420682 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae82d07-af87-4980-8f36-06938db333e1", "device": "/dev/sdb"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:49.423695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:49.430266 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.430746 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.431180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.431995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.432614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.433132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.673762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:49.688316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:49.688316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.688316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.688316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.689093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.689093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.689093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.743348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:49.750931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c82db1a8-a992-41cf-901f-7a5cb95f6636 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1311 microversion: 2.1 time: 0.080891 Oct 04 05:44:49.751480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 133/273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:49 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1311 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:49.965683 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:49.966306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:49.972192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.973315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.973745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:49.974459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:49.974901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:49.975350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:50.101089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:50.108807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b24f9000-360e-4489-9f26-321cf7032465 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.146924 Oct 04 05:44:50.109375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 134/274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:49 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:50.204585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:50.205177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:50.211588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:50.212056 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:50.212482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:50.213166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:50.213606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:50.214016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:50.349391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:50.360197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:50.360197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:50.360197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fa393054-7573-45af-90f7-145913925918 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.159550 Oct 04 05:44:50.360930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 135/275] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:50 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:44:50.775707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:50.776307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:50.782816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:50.783293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:50.783728 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:50.784408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:50.785450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:50.785879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:50.846388 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:50.854271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2b342677-5cca-4b6d-b1c4-c1dc338e0eed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1311 microversion: 2.1 time: 0.082375 Oct 04 05:44:50.854832 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 136/276] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:50 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:51.131232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:51.131756 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:51.137632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:51.138159 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:51.138593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:51.139262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:51.139971 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:51.140389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:51.400538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:51.408132 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-38af8f72-b5d2-4794-9bcf-274e727125e9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.280801 Oct 04 05:44:51.408685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 137/277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:51 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:51.413503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:51.414085 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:51.419403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:51.419871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:51.420304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:51.420973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:51.421414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:51.421825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:51.552062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:51.560181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:51.561937 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:51.563118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-309c5540-02ac-49db-9b29-479eff6817fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.153528 Oct 04 05:44:51.563671 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 138/278] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:51 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:51.877242 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:51.877869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:51.884968 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:51.885583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:51.885995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:51.886806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:51.887256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:51.887684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:51.948756 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:51.956474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e834bed8-5aaa-4900-bad2-585286566129 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1311 microversion: 2.1 time: 0.083167 Oct 04 05:44:51.957032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 139/279] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:51 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:52.431335 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:52.431940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:52.437995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:52.438598 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:52.438931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:52.439612 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:52.440060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:52.440470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:52.566585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:52.575298 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-485eacee-5ddc-4d03-9364-78e77ed28862 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.147612 Oct 04 05:44:52.575850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 140/280] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:52 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:52.588970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:52.589643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:52.595605 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:52.596082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:52.596517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:52.597198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:52.597650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:52.598074 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:52.616255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:52.741741 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:52.750050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:52.751675 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:52.762254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2601b9a7-4061-4c77-ae2b-684efb9dfb20 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.167668 Oct 04 05:44:52.762254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 141/281] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:52 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:44:52.980235 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:52.980887 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:52.986841 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:52.987323 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:52.987773 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:52.988446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:52.988894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:52.989363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:53.051202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:53.059194 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-203d55cc-0347-42e9-8053-85c2c0bca97c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1311 microversion: 2.1 time: 0.083259 Oct 04 05:44:53.060131 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 142/282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:52 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:53.598091 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:53.599074 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:53.604979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:53.605457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:53.605907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:53.606601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:53.607050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:53.607504 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:53.746395 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:53.754098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9bc19928-35d0-4f15-86ab-13f6ff688344 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.159935 Oct 04 05:44:53.754787 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 143/283] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:53 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:53.784100 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:53.784696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:53.790907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:53.791386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:53.791815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:53.792496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:53.792938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:53.793378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:53.923279 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:53.931999 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:53.933482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:53.934710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b417050d-8231-4f81-b96c-b2fffef658d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.154214 Oct 04 05:44:53.935255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 144/284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:53 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:44:54.083477 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:54.084148 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:54.085920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:54.090560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:54.097808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:54.097808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:54.097808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:54.097808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:54.098948 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:54.152687 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:54.161936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f7ff825c-7bec-462a-998a-ef9d9209ca7e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1299 microversion: 2.1 time: 0.082938 Oct 04 05:44:54.162535 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 145/285] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:54 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:54.777126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:54.777732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:54.793341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:54.794017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:54.795435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:54.796376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:54.796978 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:54.797555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:54.985885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:54.994810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ab0239aa-5809-49c1-a74f-c12df12b489b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.221603 Oct 04 05:44:54.995380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 146/286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:54 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:55.000065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:55.000677 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:55.006922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:55.007402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:55.007839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:55.008515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:55.008960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:55.009383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:55.203401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:55.211826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:55.213263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:55.214435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-aa8c5ff0-efb8-4934-9f3e-bca8a120529e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.218123 Oct 04 05:44:55.215268 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 147/287] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:54 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:55.219643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:55.220237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:55.226571 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:55.230063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:55.230063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:55.230063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:55.230063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:55.230597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:55.303802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:55.327556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-086a5aa4-beb4-4762-b1f5-57ed28433bd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1299 microversion: 2.1 time: 0.108212 Oct 04 05:44:55.327556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 148/288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:55 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:56.017425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:56.018016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:56.025054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.025775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.026234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.026923 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.027365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.027878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.196288 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:56.210354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ca986938-c01c-46b7-a927-baac6f2ef9f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1322 microversion: 2.1 time: 0.195454 Oct 04 05:44:56.212919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 149/289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:56 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:56.236118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a67c4b4f-7e19-4fa7-92e2-7c4bf8b03866 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "POST /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.815820 Oct 04 05:44:56.236118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 141/290] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:44:49 2022] POST /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80/os-volume_attachments => generated 194 bytes in 6818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:56.245348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:56.245961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:56.253140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.253643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.254155 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.254874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.256122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.256731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.349557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:56.350813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:56.358009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.361671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.361671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.361671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.361671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.362130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.509754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:56.518182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7941b1ca-05dc-42c1-a79c-bed0619d4389 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.172894 Oct 04 05:44:56.519035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 142/291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:56 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:44:56.523653 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2f5d9b46-0363-4efd-b739-8c90152273f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:56.529709 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f5d9b46-0363-4efd-b739-8c90152273f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.530398 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f5d9b46-0363-4efd-b739-8c90152273f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.530837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2f5d9b46-0363-4efd-b739-8c90152273f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.593267 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:56.599436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2f5d9b46-0363-4efd-b739-8c90152273f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Going to try to stop instance {{(pid=127392) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 05:44:56.604028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:56.605788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:56.607505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:56.609067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-979a28a6-0ba9-4d09-ac2d-330045cb76d3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1743 microversion: 2.20 time: 0.367693 Oct 04 05:44:56.626174 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 150/292] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:56 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1743 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:56.792302 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2f5d9b46-0363-4efd-b739-8c90152273f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action" status: 202 len: 0 microversion: 2.1 time: 0.272021 Oct 04 05:44:56.793083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 143/293] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:44:56 2022] POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:44:56.801487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:56.802112 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:56.808951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.809437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.809899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:56.810621 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:56.811146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:56.815348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.117549 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:57.125962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-80ece0cb-eb36-4780-a1b0-1089e010ff9f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.328451 Oct 04 05:44:57.126715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 151/294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:56 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:57.242026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:57.242026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:57.247419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.248029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.248812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.249697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.250322 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.250996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.407873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:57.418468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a59f45fa-08db-4ea3-b3e8-c7add86f80ba tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1516 microversion: 2.1 time: 0.184759 Oct 04 05:44:57.431923 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 144/295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:57 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:57.444573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:57.446921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:57.457759 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.460625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.461104 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.461835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.464185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.464973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.522302 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'flavor' on Instance uuid 98b22d78-62a0-4440-8cae-c8e5b37e99fa {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:44:57.543022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:57.543736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:57.553931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.553931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.555726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.556464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.556923 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.559659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.752795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:57.762609 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6096de94-f4ac-4129-8789-9159587d1aec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.223684 Oct 04 05:44:57.763286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 145/296] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:57 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:57.768070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-8cb8d3bc-6f38-44d3-bbe9-3ee4ad562598 req-9bf124f9-a26c-4211-a6fe-ef8cb71c4077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc490d5-7739-416e-8f18-375de3166471", "tag": "6b6831aa-36d6-46ef-9ebe-9d092eae8cf3"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:57.778975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-8cb8d3bc-6f38-44d3-bbe9-3ee4ad562598 req-9bf124f9-a26c-4211-a6fe-ef8cb71c4077 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.779443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-8cb8d3bc-6f38-44d3-bbe9-3ee4ad562598 req-9bf124f9-a26c-4211-a6fe-ef8cb71c4077 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.779902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-8cb8d3bc-6f38-44d3-bbe9-3ee4ad562598 req-9bf124f9-a26c-4211-a6fe-ef8cb71c4077 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.792234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-8cb8d3bc-6f38-44d3-bbe9-3ee4ad562598 req-9bf124f9-a26c-4211-a6fe-ef8cb71c4077 service nova] Creating event network-changed:6b6831aa-36d6-46ef-9ebe-9d092eae8cf3 for instance afc490d5-7739-416e-8f18-375de3166471 on hv-cinder-84914 Oct 04 05:44:57.797701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-8cb8d3bc-6f38-44d3-bbe9-3ee4ad562598 req-9bf124f9-a26c-4211-a6fe-ef8cb71c4077 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032883 Oct 04 05:44:57.798403 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 146/297] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:57.808525 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:57.808525 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:57.815730 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.816280 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.817317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.819221 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.819742 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.820442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.952110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d4be753a-942c-4af2-8f45-7c3807b6e720 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa/action" status: 200 len: 32 microversion: 2.1 time: 0.510799 Oct 04 05:44:57.957442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 152/298] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:44:57 2022] POST /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:44:57.958540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:57.964887 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:57.965800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:57.968903 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:57.970396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:57.971562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-104d4148-5a94-4bad-8714-934d05befb55 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1743 microversion: 2.20 time: 0.171799 Oct 04 05:44:57.972115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 147/299] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:57 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:44:57.974698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.975554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.978306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:57.978306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:57.978644 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:57.979373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:58.150368 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:58.150972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:58.159244 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:58.163114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:58.163114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:58.163114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:58.163114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:58.163672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:58.236768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:58.246284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c529d2df-2ea6-4ef6-bc73-7bf6fc834a2b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.287370 Oct 04 05:44:58.247151 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 153/300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:57 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:58.344518 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:58.354493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-36268951-2921-485c-8945-aa5152ec8a14 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.208385 Oct 04 05:44:58.355169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 148/301] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:58 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:58.787386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:58.788064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:58.794534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:58.795013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:58.795439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:58.796129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:58.796570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:58.796986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:58.998303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:58.999252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:59.016708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.017443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.018374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.019314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.019964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.020644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.092932 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:59.103117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-999294c6-fa63-4b7a-86c3-b7fcb4ba9040 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.320401 Oct 04 05:44:59.103695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 154/302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:58 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:59.200482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:59.202768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:59.204204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:59.205356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e375ff8f-5939-4f6b-b684-255256638ff6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1743 microversion: 2.20 time: 0.211356 Oct 04 05:44:59.205907 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 149/303] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:44:58 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1743 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:44:59.271816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:59.272341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:59.278645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.279352 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.279963 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.280830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.281450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.282332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.379303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:44:59.379903 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:44:59.388062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.388779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.389420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.390342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.390940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.391511 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.519582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:59.528853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2d508fc5-ac94-4d61-9d7c-e26ed59cf5df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.261009 Oct 04 05:44:59.531350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 155/304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:59 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:44:59.552284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-12f2d716-5920-4439-b9d0-3b755da5bff9 req-bd1846ef-06bb-40b3-8976-541e2705a3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "name": "network-vif-plugged", "status": "completed", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:44:59.562061 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-12f2d716-5920-4439-b9d0-3b755da5bff9 req-bd1846ef-06bb-40b3-8976-541e2705a3ca service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:44:59.562636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-12f2d716-5920-4439-b9d0-3b755da5bff9 req-bd1846ef-06bb-40b3-8976-541e2705a3ca service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:44:59.563050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-12f2d716-5920-4439-b9d0-3b755da5bff9 req-bd1846ef-06bb-40b3-8976-541e2705a3ca service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:44:59.567195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:44:59.575416 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-12f2d716-5920-4439-b9d0-3b755da5bff9 req-bd1846ef-06bb-40b3-8976-541e2705a3ca service nova] Creating event network-vif-plugged:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:44:59.581966 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-12f2d716-5920-4439-b9d0-3b755da5bff9 req-bd1846ef-06bb-40b3-8976-541e2705a3ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035949 Oct 04 05:44:59.585106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 156/305] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:44:59.617600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:44:59.625881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6dfd1b59-e54d-4d46-8e21-d8702d14ac64 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.250850 Oct 04 05:44:59.626471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 150/306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:44:59 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:00.126959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:00.127767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:00.137879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.138396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.138829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.139693 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.140245 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.140857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.234856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:00.234856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:00.236931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.237491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.238010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.239420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.240472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.240984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.295034 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:00.304508 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4d790043-8e26-4d80-b3e7-ef219d5ade2c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.182201 Oct 04 05:45:00.305583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 157/307] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:00 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:00.461357 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:00.470081 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:00.471676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:00.472939 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-76318470-7e3a-416a-bbc1-4539b56ab328 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1743 microversion: 2.20 time: 0.247777 Oct 04 05:45:00.473603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 151/308] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:00 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:00.557147 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:00.557761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:00.564281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.564788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.565207 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.565903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.566382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.566809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.648337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:00.648936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:00.664074 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.664567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.664995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.665689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:00.666411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:00.670299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:00.852600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:00.863275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4a17da43-bfa9-47bc-bfbb-7f2da06a4855 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.218349 Oct 04 05:45:00.863958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 152/309] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:00 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:01.035142 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:01.050972 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-501a63f2-f0be-4ffb-95bd-445a221af05d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.499393 Oct 04 05:45:01.052014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 158/310] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:00 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:01.329263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:01.329967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:01.345058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:01.345609 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:01.346273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:01.354838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:01.354838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:01.355733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:01.499704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:01.500307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:01.515640 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:01.516132 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:01.516846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:01.517558 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:01.518385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:01.518974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:01.752692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:01.774684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4454dbd1-fd69-4f43-a24c-d2f4b1f74573 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.443293 Oct 04 05:45:01.787325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 153/311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:01 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:01.902385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:01.903363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:01.913672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:01.914330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:01.918007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:01.918809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:01.919288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:01.921580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:01.990913 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:02.000422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:02.002358 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:02.004926 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c8683984-cfc0-48fa-b3e7-48287a2f8d16 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.509079 Oct 04 05:45:02.013359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 159/312] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:01 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:02.075425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:02.076370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:02.084622 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:02.085454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:02.086762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:02.087845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:02.089216 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:02.090628 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:02.237340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:02.268425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:02.275865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cb6a6c91-82d4-4c90-b4cc-29733750dd3d tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.363529 Oct 04 05:45:02.278439 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 154/313] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:01 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:02.279445 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e14371f1-232e-488f-8f18-033a1ded4dfb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.208289 Oct 04 05:45:02.294195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 160/314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:02 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:02.811846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:02.819914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:02.829370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:02.829370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:02.829370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:02.829755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:02.830451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:02.831028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.039666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:03.041155 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:03.051467 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:03.052088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:03.052529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.053253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:03.053700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:03.057407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.104936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:03.115139 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-74ef4a0f-2440-4d3a-a117-290cb4d10db5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.306127 Oct 04 05:45:03.117537 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 155/315] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:02 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:03.300666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:03.301269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:03.318089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:03.322293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:03.322293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.322293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:03.322293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:03.322693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.406685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:03.416175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:03.424127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:03.433465 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-36d31a69-c258-4800-bf0e-3a5fcacf24f0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.396133 Oct 04 05:45:03.438936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 161/316] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:03 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:03.461403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:03.464922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:03.472760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:03.473255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:03.474211 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.475555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:03.476200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:03.476785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:03.724417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:03.738823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5cbf5d55-0558-495a-a58c-5fb79786cec8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.292909 Oct 04 05:45:03.740022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 162/317] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:03 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:04.007499 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:04.024442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-56410136-a16d-4784-9ac8-0351e4276480 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.727087 Oct 04 05:45:04.025232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 156/318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:03 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:04.138359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:04.139871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:04.158218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.159012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.159451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.160157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.160603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.161024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.361636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:04.369902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-842178a6-4095-491e-bec7-88e0df266b5f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.236336 Oct 04 05:45:04.370530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 163/319] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:04 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:04.461610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:04.462305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:04.468360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.468932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.469388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.470094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.470575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.471385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.666445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:04.684928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:04.687863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:04.689551 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4be74902-5026-42d4-af23-8d47a1602f6d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.232345 Oct 04 05:45:04.716598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 157/320] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:04 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:04.765246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:04.766421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:04.774403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.775134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.776021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.777688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.778521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.779314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.920338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-6491a5d8-e195-44d0-a4f7-9c041df7f16a req-8e42c2a4-a3a5-40f5-b6b0-ade259269bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc490d5-7739-416e-8f18-375de3166471", "name": "network-vif-plugged", "status": "completed", "tag": "6b6831aa-36d6-46ef-9ebe-9d092eae8cf3"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:04.941684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-6491a5d8-e195-44d0-a4f7-9c041df7f16a req-8e42c2a4-a3a5-40f5-b6b0-ade259269bdf service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:04.943136 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-6491a5d8-e195-44d0-a4f7-9c041df7f16a req-8e42c2a4-a3a5-40f5-b6b0-ade259269bdf service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:04.943724 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-6491a5d8-e195-44d0-a4f7-9c041df7f16a req-8e42c2a4-a3a5-40f5-b6b0-ade259269bdf service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:04.960008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-6491a5d8-e195-44d0-a4f7-9c041df7f16a req-8e42c2a4-a3a5-40f5-b6b0-ade259269bdf service nova] Creating event network-vif-plugged:6b6831aa-36d6-46ef-9ebe-9d092eae8cf3 for instance afc490d5-7739-416e-8f18-375de3166471 on hv-cinder-84914 Oct 04 05:45:04.966562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-6491a5d8-e195-44d0-a4f7-9c041df7f16a req-8e42c2a4-a3a5-40f5-b6b0-ade259269bdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050202 Oct 04 05:45:04.967777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 158/321] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:45:05.053630 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:05.054352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:05.064927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:05.069622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:05.071997 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:05.072915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:05.073835 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:05.075399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cac77993-9869-49e2-b10b-c612534d6278 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.315316 Oct 04 05:45:05.075979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:05.076107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 164/322] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:04 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:05.077152 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:05.292962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:05.304155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-86b8622d-3ba0-44ee-aac4-da00279a0375 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.255324 Oct 04 05:45:05.306390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 159/323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:05 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:05.394490 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:05.395110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:05.422392 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:05.423190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:05.423831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:05.426637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:05.427568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:05.429035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:05.687642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:05.697069 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3ad05da2-b48b-408c-a483-6630d4ac9e44 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.307936 Oct 04 05:45:05.697655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:05 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:05.728605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:05.729652 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:05.746843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:05.747726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:05.749405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:05.750849 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:05.751478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:05.752392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:05.945857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:05.952488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:05.957437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:05.959728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:05.961018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f2179736-a39d-4d62-906d-28f453c18971 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.246878 Oct 04 05:45:05.962177 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 160/325] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:05 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:06.097894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:06.102220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:06.116463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:06.116463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:06.116463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:06.116463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:06.116959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:06.116959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:06.334869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:06.336084 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:06.347556 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:06.350544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:06.354018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:06.354018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:06.354018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:06.354018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:06.473363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:06.487918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-af313a4b-97c2-4cbd-997a-05b2d3866176 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.393681 Oct 04 05:45:06.499852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 166/326] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:06 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:06.622478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:06.632678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-708d170a-f994-4162-b48a-4a328a5e41b0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.307642 Oct 04 05:45:06.634163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 161/327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:06 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:06.720915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:06.721813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:06.729074 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:06.729679 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:06.730241 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:06.731310 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:06.732365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:06.732998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:06.978729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:06.993074 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:06.993821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:07.000854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cf6c5e7a-05df-43bb-93a5-2fdcf11ed96f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.284506 Oct 04 05:45:07.001578 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 167/328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:06 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:07.003156 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:07.004039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:07.004880 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:07.005814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:07.006613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:07.007421 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:07.221106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:07.241479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:07.244151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:07.246232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a5b747f7-cef1-4e24-a272-f559c12da6e9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.257775 Oct 04 05:45:07.254218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 162/329] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:06 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:07.536605 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:07.537340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:07.547474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:07.547870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:07.548297 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:07.549000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:07.549698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:07.550192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:07.663220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:07.665078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:07.672744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:07.673621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:07.674283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:07.675377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:07.675986 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:07.677581 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:07.885006 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:07.914603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-454d5fe7-334e-4f54-a5be-7a62d2de4583 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.398189 Oct 04 05:45:07.915544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 168/330] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:07 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:07.926253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:07.934635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-48a6037a-0bab-4c70-b0e3-a717f6e4e97a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.281358 Oct 04 05:45:07.938420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 163/331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:07 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:08.027618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:08.028600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:08.040056 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.044874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.044874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.044874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.044874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.045651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.270785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:08.277188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:08.278028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:08.280383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d6343c97-b8a0-4072-bd06-ecffb8241e1b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.259325 Oct 04 05:45:08.282417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:08 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:08.304347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.305301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.305909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.306843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.307465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.307898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.455503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:08.465006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:08.467797 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:08.469305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-12cf9f06-dc89-4915-ba8a-057f93efe4ba tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.196043 Oct 04 05:45:08.482731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 164/333] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:08 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:08.939194 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:08.940462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:08.948254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.948738 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.949174 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.949869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.950404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.951086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.960166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:08.961608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:08.971351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.972140 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.972781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:08.973691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:08.974446 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:08.975028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:09.157305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:09.167340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8f7421f8-6731-444f-a85f-fe500d86f36c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.211640 Oct 04 05:45:09.175353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 165/334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:08 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:09.201169 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:09.209762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0a57617f-e2ae-4f74-bb30-56f694a0946f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.274566 Oct 04 05:45:09.211120 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 170/335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:08 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:09.309219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:09.309484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:09.320779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:09.321485 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:09.322600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:09.323456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:09.324536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:09.325565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:09.495782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:09.496582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:09.513062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:09.513944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:09.514626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:09.516607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:09.517535 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:09.519037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:09.560940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:09.569539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c478029c-84bc-457a-96e7-c8d0c533a9d6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.264424 Oct 04 05:45:09.575987 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 166/336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:09 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:09.779522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:09.795399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:09.797736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:09.799257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-798ea217-f722-47d1-8fd6-14c6691feccc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.307387 Oct 04 05:45:09.800317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 171/337] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:09 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:10.198754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:10.200646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:10.215054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.218972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.219752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.221547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.225036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.228289 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.238340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:10.240231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:10.252534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.253209 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.253827 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.254808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.258810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.259460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.433618 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:10.444844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4b701e94-9970-4385-b9bc-b538d5b51b77 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.256891 Oct 04 05:45:10.446001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 167/338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:10 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:10.465771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:10.474405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-76e54028-576a-4b94-8c7c-ffb819739722 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.244797 Oct 04 05:45:10.475187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 172/339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:10 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:10.601467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:10.602470 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:10.612871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.613846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.614690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.615621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.616310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.616947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.775336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:10.785354 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-43f8d93e-8eb7-4511-be3b-cfa8749f42a2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1367 microversion: 2.1 time: 0.186604 Oct 04 05:45:10.787172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 168/340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:10 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:10.827538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:10.828458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:10.839303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.845111 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.845872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.846817 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:10.848064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:10.849332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:10.877888 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:11.087019 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:11.103624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:11.113298 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:11.121751 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-64db188f-2c30-4d62-b4c8-1ef3951acc42 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.298170 Oct 04 05:45:11.142950 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 173/341] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:10 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:11.468440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:11.469676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:11.478001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:11.480896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:11.481272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:11.482002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:11.482547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:11.482984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:11.497992 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:11.498559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:11.513524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:11.514420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:11.514870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:11.516375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:11.523633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:11.524327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:11.830569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:11.840742 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8a204383-18be-4732-b22e-41bd940fe8ae tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.376072 Oct 04 05:45:11.841992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 169/342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:11 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:11.854879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:11.855823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:11.866541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=81 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:11.868099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:11.869798 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:11.870373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:11.872013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:11.874094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:11.874810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:11.894407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:11.908949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-239e20a5-e404-4b41-98b8-c01f0fb7bb82 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.415687 Oct 04 05:45:11.909801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 174/343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:11 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:12.133171 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:12.145783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b8239e57-48a8-4115-974b-814017e6ef46 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1558 microversion: 2.1 time: 0.298577 Oct 04 05:45:12.149685 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 170/344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:11 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1558 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:12.153261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:12.153869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:12.163874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.164358 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.164797 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.165507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.165949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.166396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.177911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:12.178695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:12.191470 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.191984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.194895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.195986 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.196781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.200084 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.325176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7bd72fd5-f783-41c5-bfd0-c6a15a36b304 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151533 Oct 04 05:45:12.328235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 171/345] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:45:12 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:45:12.634246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:12.643482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:12.647457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:12.648420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0cd647f2-1f7b-4e51-8425-83e025eea207 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.498094 Oct 04 05:45:12.649371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 175/346] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:12 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:12.903966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:12.917824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:12.939017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:12.939630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:12.953737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.956285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.956285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.956285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.956285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.964909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.965236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.965850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.969022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:12.969413 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:12.970090 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:12.974259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:13.170269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:13.179376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c84017d8-558c-4753-9026-a160e08f693b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.288090 Oct 04 05:45:13.179941 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 172/347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:12 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:13.387142 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:13.395890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-39d6c511-ad67-4a74-81bd-7becb139c855 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.460938 Oct 04 05:45:13.415196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 176/348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:12 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:13.682342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:13.688976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:13.694084 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:13.696176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:13.696814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:13.697529 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:13.700414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:13.701160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:13.927593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:13.940730 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:13.943179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:13.944558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fbd3ccd8-4df1-44d1-80fe-078db88b7c7e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.271626 Oct 04 05:45:13.959375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 173/349] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:13 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:14.204822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:14.206414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:14.228568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.229959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.230792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.231969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.232806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.233594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.438419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:14.439358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:14.447153 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.447950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.448633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.449538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.450235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.450870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.625223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:14.634087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1e316c8f-5740-4ca8-be8d-15a9f1a0444c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.200691 Oct 04 05:45:14.635901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 174/350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:14 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:14.707033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:14.715965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-606ef3bc-7f50-4108-9bb9-5bc708a9075b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.514972 Oct 04 05:45:14.719807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 177/351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:14 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:14.948081 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-b7941ffc-fc85-4514-b3d8-527cbecd6a91 req-be697f34-eaa3-430c-9388-fdce1db0d225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc490d5-7739-416e-8f18-375de3166471", "tag": "6b6831aa-36d6-46ef-9ebe-9d092eae8cf3"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:14.958992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-b7941ffc-fc85-4514-b3d8-527cbecd6a91 req-be697f34-eaa3-430c-9388-fdce1db0d225 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.960036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-b7941ffc-fc85-4514-b3d8-527cbecd6a91 req-be697f34-eaa3-430c-9388-fdce1db0d225 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.960696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-b7941ffc-fc85-4514-b3d8-527cbecd6a91 req-be697f34-eaa3-430c-9388-fdce1db0d225 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.972434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:14.973568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:14.985181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-b7941ffc-fc85-4514-b3d8-527cbecd6a91 req-be697f34-eaa3-430c-9388-fdce1db0d225 service nova] Creating event network-changed:6b6831aa-36d6-46ef-9ebe-9d092eae8cf3 for instance afc490d5-7739-416e-8f18-375de3166471 on hv-cinder-84914 Oct 04 05:45:14.988452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.989672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.990463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.991373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:14.991996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:14.992441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:14.993705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-b7941ffc-fc85-4514-b3d8-527cbecd6a91 req-be697f34-eaa3-430c-9388-fdce1db0d225 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049046 Oct 04 05:45:15.000341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 175/352] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:45:15.239199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:15.251259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:15.253573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:15.263462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a1241329-a3ed-4c34-823e-bcb066e1ad22 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.294910 Oct 04 05:45:15.264716 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 178/353] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:14 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:15.657962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:15.659136 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:15.670099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:15.676072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:15.676979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:15.678015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:15.678716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:15.679422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:15.745196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:15.745805 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:15.760161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:15.760660 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:15.762034 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:15.763036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:15.763689 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:15.764309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:16.032953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:16.050694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-723fca6b-62f8-48b3-8931-d4a6635688cc tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.391436 Oct 04 05:45:16.051776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 176/354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:15 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:16.251755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:16.266861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-86988d0a-4b76-4087-a791-93c8c3b8dd01 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.526239 Oct 04 05:45:16.279462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 179/355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:15 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:16.297543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:16.298785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:16.310924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:16.315062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:16.315840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:16.318188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:16.318849 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:16.319878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:16.684865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:16.716164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:16.721292 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:16.724343 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-88e4d8ad-5449-4f32-b321-4581202a2be4 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.432949 Oct 04 05:45:16.726849 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 177/356] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:16 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:17.076872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:17.077479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:17.088909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:17.089401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:17.090042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:17.090929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:17.091382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:17.097865 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:17.290828 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:17.292388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:17.293153 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:17.300744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:17.316524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-aba6ade1-6eeb-4f45-94a2-e71af6efd5c0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.229318 Oct 04 05:45:17.317311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:17.317311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:17.317311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:17.317311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:17.317648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:17.317736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 180/357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:17 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:17.361290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:17.529886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:17.540078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bdf546e6-5177-414e-bd11-28d8bc14176e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.251474 Oct 04 05:45:17.541456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 178/358] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:17 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:17.755418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:17.756154 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:17.778116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:17.781064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:17.781700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:17.782748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:17.783360 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:17.783932 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:18.012242 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:18.021654 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:18.023567 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:18.025799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fd4b1a5d-b0b2-4a67-9367-cbc70269c3e5 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.274973 Oct 04 05:45:18.027019 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 181/359] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:17 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:18.331692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:18.332991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:18.345881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:18.347220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:18.349101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:18.351704 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:18.353415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:18.354152 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:18.532977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:18.541613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8ef68bd0-8346-4e92-ba7c-e621f8fbec2e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.213867 Oct 04 05:45:18.553023 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 179/360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:18 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:18.565839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:18.566788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:18.574304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:18.574806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:18.575241 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:18.576204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:18.576889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:18.577325 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:18.733534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:18.743105 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a3934aac-d7ec-45f5-8875-b3428a08f419 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.181673 Oct 04 05:45:18.743813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 182/361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:18 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:19.051776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:19.052385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:19.058460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:19.058962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:19.059400 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:19.060122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:19.060576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:19.061004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:19.216021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:19.234241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:19.238966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:19.240810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-39bed431-e28d-49d0-89e6-a4934d10a2ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.193040 Oct 04 05:45:19.244308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 180/362] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:19 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:19.581035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:19.582407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:19.590892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:19.592103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:19.592740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:19.596148 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:19.597120 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:19.600402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:19.769491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:19.770157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:19.788624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:19.789552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:19.790198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:19.794370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:19.796950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:19.797565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:19.818189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:19.828254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e6751de3-26fc-45ea-8bfe-72aef1357eab tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.261353 Oct 04 05:45:19.828831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 183/363] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:19 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:20.035019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:20.053216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-80e8c20e-1db1-477b-99d3-cbbd67b77d68 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.282237 Oct 04 05:45:20.053216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 181/364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:19 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:20.270503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:20.271211 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:20.282004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:20.287615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:20.291304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:20.291304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:20.291304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:20.291304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:20.487011 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:20.499950 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:20.508267 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:20.509990 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e5eecbee-5e52-4938-b300-5804b8600080 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1738 microversion: 2.20 time: 0.243423 Oct 04 05:45:20.511407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 184/365] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:20 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:20.852930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:20.857097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:20.867458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:20.868221 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:20.868829 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:20.869751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:20.870392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:20.872111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:21.078882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:21.085770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:21.087024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:21.092191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-73075b81-d4bd-4160-8988-214390199c13 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.243129 Oct 04 05:45:21.102489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:21.103269 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:21.103929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:21.105723 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:21.107936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 182/366] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:20 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:21.111035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:21.111314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:21.308332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:21.317557 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e2803710-22d5-4984-82bb-79b189cf625a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.247154 Oct 04 05:45:21.318327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 185/367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:21 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:21.541582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:21.542757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:21.567605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:21.570838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:21.572471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:21.573237 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:21.576099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:21.576622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:21.829099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:21.839131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:21.840624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:21.841810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-22c5996f-b35f-41c6-ad79-6411ddf40230 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1720 microversion: 2.20 time: 0.309595 Oct 04 05:45:21.844853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 183/368] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:21 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1720 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:22.120475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:22.121215 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:22.128475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:22.129813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:22.130393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:22.131390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:22.132063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:22.132722 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:22.364141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:22.364795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:22.382109 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:22.382109 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:22.388690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:22.394051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:22.399634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:22.403183 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:22.619775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:22.629758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a0166e5b-f001-4819-889f-2e18a5a0df95 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.512586 Oct 04 05:45:22.630385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 186/369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:22 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:22.721132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:22.721132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b3da8229-4460-4dc0-9d65-d6dd2d037257 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.382505 Oct 04 05:45:22.764520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 184/370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:22 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:22.868012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:22.869003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:22.875963 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:22.876779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:22.877428 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:22.878370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:22.879556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:22.880171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:23.063002 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:23.072589 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:23.074092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:23.075538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-283221be-e1f0-4a57-8f76-3a286806c1f6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1720 microversion: 2.20 time: 0.212310 Oct 04 05:45:23.076119 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 187/371] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:22 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:23.654619 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:23.655189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:23.662419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:23.662925 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:23.663357 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:23.664056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:23.664646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:23.665245 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:23.772531 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:23.773135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:23.779522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:23.780389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:23.781060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:23.781997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:23.782729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:23.784619 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:23.819784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:23.830944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-06e82cbb-8fa1-4d7c-b877-12cc2b7f3f0b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.180546 Oct 04 05:45:23.831870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 185/372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:23 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:23.951915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:23.961851 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-316d6c5c-0ec4-4853-85b3-2530c49b50fb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.193661 Oct 04 05:45:23.974936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 188/373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:23 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:24.083159 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-9f8e42a4-d01d-4b2a-9de9-1c08195145f9 req-618401ae-7944-4466-b98d-856dfc0b19c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "name": "network-vif-unplugged", "status": "completed", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:24.101799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:24.102411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:24.108721 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-9f8e42a4-d01d-4b2a-9de9-1c08195145f9 req-618401ae-7944-4466-b98d-856dfc0b19c9 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.109206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-9f8e42a4-d01d-4b2a-9de9-1c08195145f9 req-618401ae-7944-4466-b98d-856dfc0b19c9 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.109639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-9f8e42a4-d01d-4b2a-9de9-1c08195145f9 req-618401ae-7944-4466-b98d-856dfc0b19c9 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:24.115541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.116048 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.116457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:24.117182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.117624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.118041 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:24.136657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-9f8e42a4-d01d-4b2a-9de9-1c08195145f9 req-618401ae-7944-4466-b98d-856dfc0b19c9 service nova] Creating event network-vif-unplugged:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:45:24.150667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-9f8e42a4-d01d-4b2a-9de9-1c08195145f9 req-618401ae-7944-4466-b98d-856dfc0b19c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074120 Oct 04 05:45:24.152394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 186/374] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:45:24.293443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:24.305055 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:24.306812 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:24.308261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-611d6da9-19ee-4b6d-becb-ec48ab6c6d4b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1720 microversion: 2.20 time: 0.210431 Oct 04 05:45:24.319106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 189/375] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:24 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:24.857018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:24.858323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:24.868029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.872045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.872045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:24.872045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.872045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.872434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:24.986894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:24.995844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:24.995844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=90 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:24.995844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.995844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.995844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:24.996710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:24.997303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:24.997870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.003026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:25.028223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:25.037281 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fe4aa191-ab86-4890-9c8a-6728fefcefb0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.184598 Oct 04 05:45:25.039268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 187/376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:24 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:25.162632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:25.172220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f3ae67c9-eb07-48be-b770-78f24952dddc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.189226 Oct 04 05:45:25.174202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 190/377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:24 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:25.335540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:25.336143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:25.349200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:25.349686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:25.350122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.351017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:25.364362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:25.364929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.491723 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:25.492221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:25.499191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:25.499805 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:25.500245 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.500949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:25.501395 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:25.501897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.547433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:25.557378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:25.559144 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:25.560398 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-57ba6513-3454-48e8-b4c6-2132c50ad8ab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1723 microversion: 2.20 time: 0.229550 Oct 04 05:45:25.570214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 188/378] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:25 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:25.593599 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80afebb8-eb83-4928-8484-31b39d0c9a7e"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:25.596215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:25.609129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:25.609624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:25.610060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.610787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:25.611240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:25.611707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:25.666528 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lazy-loading 'services' on Instance uuid 2fdc3b68-5d3e-436c-974c-ca863a46af80 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:45:26.053879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dbf51d7e-ccd0-493f-9dc5-c96b23ec05e2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80/os-volume_attachments/3ae82d07-af87-4980-8f36-06938db333e1" status: 202 len: 0 microversion: 2.1 time: 0.568346 Oct 04 05:45:26.056035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 191/379] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:45:25 2022] DELETE /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80/os-volume_attachments/3ae82d07-af87-4980-8f36-06938db333e1 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:45:26.062328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:26.065644 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:26.070928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:26.071840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:26.072501 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:26.073457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:26.074121 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:26.074809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:26.248802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:26.265670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5f850776-dfbb-40dc-8aff-e7c4d39f4b00 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.208132 Oct 04 05:45:26.267421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 192/380] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:26 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:26.280486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:26.281230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:26.291624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:26.292302 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:26.292810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:26.293658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:26.294274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:26.294904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:26.480726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:26.490410 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ff87c0ef-7945-4967-b9b3-49379a61c1ac tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1722 microversion: 2.1 time: 0.213959 Oct 04 05:45:26.491196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 193/381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:26 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:27.297707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:27.298491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:27.305391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.307776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.307776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.307776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.307776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.308433 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.330500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ecc18e5c-ff27-416a-84dc-ab15830c9f3f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.741173 Oct 04 05:45:27.333814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 189/382] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 4 05:45:25 2022] POST /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments => generated 188 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 05:45:27.476365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:27.493969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-334fb9b2-45ac-4b4c-86e2-c8fc06164e54 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.201442 Oct 04 05:45:27.498226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:27.499141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:27.505278 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 194/383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:27 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:27.510505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.511196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.511787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.512659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.513499 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.514079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.519860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:27.521706 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:27.527836 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.528414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.529093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.530175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.530642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.531148 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.592801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127392) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 05:45:27.680533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:27.690599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-64018a82-3605-49ff-a3e7-ddbf85cb2891 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1699 microversion: 2.1 time: 0.175181 Oct 04 05:45:27.708780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 195/384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:27 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1699 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:27.715100 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0e64e63e-184b-4db9-885a-d8d640dc5965 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:27.723771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e64e63e-184b-4db9-885a-d8d640dc5965 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:27.724523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e64e63e-184b-4db9-885a-d8d640dc5965 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:27.725178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e64e63e-184b-4db9-885a-d8d640dc5965 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:27.791931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0e64e63e-184b-4db9-885a-d8d640dc5965 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Going to try to start instance {{(pid=127393) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 05:45:27.979641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a8a92eaa-e4f1-41fc-83d1-1313df9e36b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/action" status: 202 len: 0 microversion: 2.20 time: 0.487291 Oct 04 05:45:27.980955 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 190/385] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 05:45:27 2022] POST /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 05:45:27.993475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:27.998286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:28.012220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:28.013079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:28.015686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:28.016775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:28.018648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:28.019388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:28.035455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0e64e63e-184b-4db9-885a-d8d640dc5965 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action" status: 202 len: 0 microversion: 2.1 time: 0.324100 Oct 04 05:45:28.036588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 196/386] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:45:27 2022] POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:45:28.046640 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:28.047341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:28.057558 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:28.058050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:28.058540 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:28.059247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:28.059696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:28.060262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:28.197686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:28.211092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:28.213557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:28.215848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3dc487e0-88d2-4ab0-ae07-80c979d57f47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1749 microversion: 2.20 time: 0.227934 Oct 04 05:45:28.216950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 191/387] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:27 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1749 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:28.354217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:28.370301 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-47d047a2-d294-46ac-8816-ccdc919cf4b1 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1708 microversion: 2.1 time: 0.326561 Oct 04 05:45:28.386167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 197/388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:28 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1708 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:28.523077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:28.523692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:28.536803 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:28.537323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:28.537764 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:28.538656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:28.539219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:28.539649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:28.545394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:28.710703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:28.720894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c1822b05-6b96-4e8c-aaf2-1a8f7d928da1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.201576 Oct 04 05:45:28.737973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 192/389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:28 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:29.250435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:29.251191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:29.258205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.258783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.259488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.260390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.261209 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.262093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.396141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:29.396749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:29.407855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.408347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.410552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.415979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.416636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.417082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.521452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:29.532546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:29.534294 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:29.535659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-05c3539a-cfc6-44b4-a9a7-9e694e14f9a7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1749 microversion: 2.20 time: 0.291417 Oct 04 05:45:29.536457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 198/390] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:29 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1749 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:29.550409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:29.552723 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:29.561697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.562483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.563220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.564047 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.565137 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.566043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.603165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:45:29.607526 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:29.619499 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-600fa81b-891b-4718-a8dc-b183f9d1bb6f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1708 microversion: 2.1 time: 0.228243 Oct 04 05:45:29.634711 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 193/391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:29 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1708 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:29.752394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:29.753007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:29.759503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.760228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.760675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.761541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:29.762336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:29.762710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:29.964778 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:29.972778 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f040aa06-3065-4940-a5c2-e27b92d380c4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1522 microversion: 2.1 time: 0.229954 Oct 04 05:45:29.974191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 194/392] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:29 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:30.004824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7f0c9a72-04e9-4ed9-8079-db63e6ccc87f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 204 len: 0 microversion: 2.1 time: 0.466674 Oct 04 05:45:30.005659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 199/393] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:45:29 2022] DELETE /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:45:30.019673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:30.019673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:30.021194 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:30.021761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:30.022297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:30.023188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:30.023699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:30.024186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:30.168823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:30.177703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a30a546d-8126-421d-bc57-09d4b31ec06e tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1513 microversion: 2.1 time: 0.167794 Oct 04 05:45:30.178601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 195/394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:30 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:30.564901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:30.565579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:30.573776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:30.574420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:30.575038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:30.576113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:30.576770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:30.577353 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:30.651019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:30.651608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:30.667496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:30.668041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:30.668532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:30.669437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:30.669937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:30.670377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:30.742171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:30.750803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:30.752244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:30.753399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e6090fcf-45dc-46e1-896c-71d77d205711 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1749 microversion: 2.20 time: 0.193329 Oct 04 05:45:30.753955 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 200/395] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:30 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1749 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:30.798351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:30.807473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-76d38687-02aa-4bad-a245-c619303008ba tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1708 microversion: 2.1 time: 0.160391 Oct 04 05:45:30.808042 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 196/396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:30 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:30.996036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:30.996565 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:31.005405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.005890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.006364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.007055 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.007509 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.007936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.135885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:31.143580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3b066e2b-cf39-466f-a61f-f68a462e5179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1502 microversion: 2.1 time: 0.151451 Oct 04 05:45:31.144135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 201/397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:30 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:31.166001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:31.166667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:31.172921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.173406 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.173837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.174575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.175094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.175438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.202180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:31.202947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:31.211922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.212864 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.213411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.214282 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.214969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.215616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.323837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:31.333176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-75d05a84-07d9-4e2f-9acb-59467e268cd8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1515 microversion: 2.1 time: 0.170769 Oct 04 05:45:31.346164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 197/398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:31 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:31.619420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:31.629620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c1852724-09a8-44ff-a8d0-717a308b8951 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1513 microversion: 2.1 time: 0.431837 Oct 04 05:45:31.631137 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 202/399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:31 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1513 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:31.785723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:31.786362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:31.792802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.793278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.793707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.794433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.794881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.795303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.852498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:31.852844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:31.863910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.864400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.865350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.866053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:31.866744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:31.867167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:31.886810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:31.947316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:31.977145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:31.978614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:31.979964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-aa94db98-8e40-419b-8484-60b050749304 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1749 microversion: 2.20 time: 0.198478 Oct 04 05:45:31.981677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 198/400] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:31 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1749 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:32.009163 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:32.016602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-71d33c97-4202-41eb-aaf9-147601919a4f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1708 microversion: 2.1 time: 0.168450 Oct 04 05:45:32.017175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 203/401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:31 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:32.120638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b4fa426f-c074-4d89-9f32-d8151cd3edb8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Action: 'create', calling method: .version_select at 0x7f04866da5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-296923354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9XJ8OHS9oBs3FwGT23rQIbtZYuhCuyXBA2enZ+V2ibwOW6oOd7thuy/Zi9woR5+jyFOeKSIjZJ5Td6OAlGK6PgK1Ib8KVSOw2azklojCGPflwvFlTeAZTegpjUYybUYw=="}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:32.135788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-b4fa426f-c074-4d89-9f32-d8151cd3edb8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Getting quotas for project c237fdd93f3e47dea64bd0143f09b819. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:45:32.139972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-b4fa426f-c074-4d89-9f32-d8151cd3edb8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Getting quotas for user db24ed507ded40fe828c84bc138f893b and project c237fdd93f3e47dea64bd0143f09b819. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:45:32.258339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b4fa426f-c074-4d89-9f32-d8151cd3edb8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.141482 Oct 04 05:45:32.258962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 199/402] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:45:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:45:32.312365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-344979064", "imageRef": "380711d7-cd88-45dc-baf7-683dc3e33a46", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-296923354", "networks": [{"uuid": "8c99016d-f252-4011-a226-d600412012eb"}]}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:32.364965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] validate_networks() for [('8c99016d-f252-4011-a226-d600412012eb', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:45:32.653340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:32.653954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:32.660414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:32.660899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:32.661826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:32.662552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:32.663007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:32.663504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:32.810254 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:32.819678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-91d19338-e717-41ed-902e-ce47361a7e18 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1513 microversion: 2.1 time: 0.170524 Oct 04 05:45:32.826902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 200/403] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:32 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:32.993593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:45:32.994059 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:45:32.994552 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:45:32.995167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:45:32.995579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:45:33.004792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.005376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.005817 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.006281 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:33.006562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.007013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.007155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:33.007436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.014571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.015182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.015938 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.016760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.017319 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.017788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.025446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Getting quotas for project c237fdd93f3e47dea64bd0143f09b819. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:45:33.030240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Getting quotas for user db24ed507ded40fe828c84bc138f893b and project c237fdd93f3e47dea64bd0143f09b819. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:45:33.045682 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:45:33.048260 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='380711d7-cd88-45dc-baf7-683dc3e33a46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:45:33.184511 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0cad051a-2cdf-4b9a-87e4-7c2d933778ea tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876111 Oct 04 05:45:33.192314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 204/404] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:45:33.197809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:33.198932 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:33.208894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.209755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.210401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.211143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.211598 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.212031 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.404188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:33.413811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:33.415493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:33.417186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9912a7e6-8fa1-47e3-9fe5-9f4c07ba31df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1751 microversion: 2.20 time: 0.415206 Oct 04 05:45:33.417690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 201/405] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:33 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1751 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:33.419827 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:33.422270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-125a60a4-46cd-4f57-af9a-56d95484fbda tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:33.423056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-125a60a4-46cd-4f57-af9a-56d95484fbda tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:33.430183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f8a5b93f-f041-4d63-bf86-f159d1062095 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1712 microversion: 2.1 time: 0.236124 Oct 04 05:45:33.436619 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 205/406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:33 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1712 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:33.441701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-4a3b4878-b738-4de5-936c-adbe8f126bc9 req-b8ddc170-d2db-4fc5-b23a-123f192b8b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdc3b68-5d3e-436c-974c-ca863a46af80", "name": "network-vif-deleted", "tag": "14c00f98-c139-425e-822a-24588d96e045"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:33.458942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-4a3b4878-b738-4de5-936c-adbe8f126bc9 req-b8ddc170-d2db-4fc5-b23a-123f192b8b1c service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.459559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-4a3b4878-b738-4de5-936c-adbe8f126bc9 req-b8ddc170-d2db-4fc5-b23a-123f192b8b1c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.460114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-4a3b4878-b738-4de5-936c-adbe8f126bc9 req-b8ddc170-d2db-4fc5-b23a-123f192b8b1c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.472607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-4a3b4878-b738-4de5-936c-adbe8f126bc9 req-b8ddc170-d2db-4fc5-b23a-123f192b8b1c service nova] Creating event network-vif-deleted:14c00f98-c139-425e-822a-24588d96e045 for instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 on hv-cinder-84914 Oct 04 05:45:33.478790 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-4a3b4878-b738-4de5-936c-adbe8f126bc9 req-b8ddc170-d2db-4fc5-b23a-123f192b8b1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040299 Oct 04 05:45:33.479399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 206/407] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:45:33.485226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:33.487907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:33.492670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-125a60a4-46cd-4f57-af9a-56d95484fbda tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:33.494637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.495121 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.495745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.499902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.499902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.499902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.500710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-125a60a4-46cd-4f57-af9a-56d95484fbda tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1257 microversion: 2.1 time: 0.082032 Oct 04 05:45:33.501279 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 202/408] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:33 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:33.523143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'flavor' on Instance uuid f27eb826-a49d-4d1d-a843-cc725fae592b {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:45:33.843409 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:33.844141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:33.851677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.852350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.853035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.853941 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.854571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.855195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.863664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-78a01feb-2f18-44f5-812c-0e5271b3f56b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/action" status: 200 len: 32 microversion: 2.1 time: 0.382682 Oct 04 05:45:33.869065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 207/409] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:45:33 2022] POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:45:33.874574 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:33.876451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:33.884515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.900788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.901231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.901912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.902907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:33.903227 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.903613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.903979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:33.904115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lazy-loading 'fault' on Instance uuid 2fdc3b68-5d3e-436c-974c-ca863a46af80 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:45:33.904409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:33.952849 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:33.969521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-242cc04a-57bb-4dd2-92c3-d8be15ab0d10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 200 len: 1309 microversion: 2.1 time: 0.129636 Oct 04 05:45:33.970426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 203/410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:33 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:34.072469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:34.083032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bd703ffe-ef5d-4182-bb92-7b0dc3f592da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.212295 Oct 04 05:45:34.099684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 208/411] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:33 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:34.452321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:34.453046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:34.459548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:34.460024 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:34.460455 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:34.461143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:34.461590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:34.462008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:34.523577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1fdafc5c-2421-4f8e-ba5d-9179a916f261 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:34.524204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1fdafc5c-2421-4f8e-ba5d-9179a916f261 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:34.597556 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:34.606326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:34.607761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:34.608926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-664dbe91-1fdf-4774-a1ef-b89295d26eda tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1751 microversion: 2.20 time: 0.160691 Oct 04 05:45:34.609479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 204/412] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:34 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:34.622764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1fdafc5c-2421-4f8e-ba5d-9179a916f261 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:34.630013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1fdafc5c-2421-4f8e-ba5d-9179a916f261 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1257 microversion: 2.1 time: 0.110911 Oct 04 05:45:34.633189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 209/413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:34 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1257 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:34.999043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:34.999625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 2fdc3b68-5d3e-436c-974c-ca863a46af80] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:35.006022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.006528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.007132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.007817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.008260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.008674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.021925 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] HTTP exception thrown: Instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 could not be found. Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Request method failure captured: Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 HTTP/1.1 Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8gWxKi4A8atfPk3zn-MqhP5d_Qwgwv65IIM6QBIzLuY-FXBtdH41uLkaJ4hLb2PIMyD7thxrp6umy-PcGkS09x8JXpE9_vqNpVNl2v6dwSZtHWCzNqZdZmv05FBySLbN8Yu79Dmr_1jxl8Qj_o6GIstyrcASQWzjyehy2SXyWcgIlE Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: e003d2bea5f04ac7a70fd2b7d2ee1f91 Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesSnapshotTestJSON-849826855 Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:45:35.023582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e003d2bea5f04ac7a70fd2b7d2ee1f91", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e003d2bea5f04ac7a70fd2b7d2ee1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e003d2bea5f04ac7a70fd2b7d2ee1f91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e003d2bea5f04ac7a70fd2b7d2ee1f91"}]}] Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesSnapshotTestJSON-849826855 Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: e003d2bea5f04ac7a70fd2b7d2ee1f91 Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-849826855 Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesSnapshotTestJSON-849826855-project Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 877575c9e0264241b9eab868a89cbbe8 Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesSnapshotTestJSON-849826855-project Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 could not be found. Oct 04 05:45:35.025161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '2fdc3b68-5d3e-436c-974c-ca863a46af80'} Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 could not be found. Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:45:35.026078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 could not be found. Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 could not be found. Oct 04 05:45:35.027684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:35.029788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Returning 404 to user: Instance 2fdc3b68-5d3e-436c-974c-ca863a46af80 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:45:35.029788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1ab56803-92cc-41df-b561-3196d44b02d7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80" status: 404 len: 111 microversion: 2.1 time: 0.029905 Oct 04 05:45:35.029788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 205/414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:34 2022] GET /compute/v2.1/servers/2fdc3b68-5d3e-436c-974c-ca863a46af80 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:45:35.108863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:35.109466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:35.116651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.117128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.117564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.121130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.121130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.121130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.248230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:35.255998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0b752c52-8919-4dfc-a5e7-b9543ac3d6c9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.151482 Oct 04 05:45:35.256560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 210/415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:35 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:35.635995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:35.636618 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:35.642487 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.642958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.643384 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.644060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.644500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.644914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.656597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:35.657251 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:35.664354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.664831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.665263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.665951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:35.666435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:35.666863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:35.726586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:35.734403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-459535b0-8318-4ae2-8d61-7da7c15b86a8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1253 microversion: 2.1 time: 0.081485 Oct 04 05:45:35.734982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 211/416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:35 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1253 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:35.776768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:35.785398 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:35.786908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:35.788041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f2b79ba7-8c10-4965-8c20-0bc7b799087c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.155921 Oct 04 05:45:35.788587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 206/417] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:35 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:36.288404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:36.289000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:36.294949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:36.295422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:36.295850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:36.296522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:36.296964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:36.297379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:36.422457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:36.430629 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e295c25e-a20e-4085-8d4a-4f6f38f1236d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.146219 Oct 04 05:45:36.431186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 212/418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:36 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:36.758250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:36.758856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:36.764899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:36.765371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:36.765807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:36.766510 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:36.766954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:36.767452 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:36.813224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:36.813915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:36.820431 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:36.821008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:36.821512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:36.822308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:36.822855 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:36.823350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:36.826966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:36.835125 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5ff09601-a33d-48f7-a6d6-01aec7a37115 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1309 microversion: 2.1 time: 0.081792 Oct 04 05:45:36.836036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 207/419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:36 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:36.953787 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:36.962762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:36.964200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:36.965337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f361a59d-2592-437b-9259-6cdbf517085a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.156321 Oct 04 05:45:36.965883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 213/420] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:36 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:37.452721 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:37.453317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:37.459305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:37.459777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:37.460202 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:37.460908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:37.461350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:37.461768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:37.589943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:37.597922 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a0425e91-2b3d-41ac-b413-8a18ace27282 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.149022 Oct 04 05:45:37.598559 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 208/421] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:37 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:37.858423 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:37.859025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:37.865674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:37.866158 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:37.866682 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:37.867355 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:37.867795 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:37.868210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:37.928617 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:37.936667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4ddad14b-a758-4f17-aa82-35452e418554 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1309 microversion: 2.1 time: 0.081922 Oct 04 05:45:37.937226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 214/422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:37 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:37.990772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:37.991373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:37.997718 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:37.998286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:37.998719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:37.999396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:37.999839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:38.000255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:38.123325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:38.132290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:38.133710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:38.134876 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d60961ee-faba-48be-a0fe-f6641b94fd74 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.148001 Oct 04 05:45:38.135432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 209/423] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:37 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:38.621394 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:38.622030 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:38.628082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:38.628568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:38.629013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:38.629708 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:38.630792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:38.631222 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:38.804333 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:38.812296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-96dbe9fa-5e73-4f1b-b335-9133b6dff030 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.195083 Oct 04 05:45:38.812896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 215/424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:38 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:38.959770 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:38.960310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:38.963235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:38.966578 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:38.967054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:38.967469 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:38.968147 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:38.968588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:38.969005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:39.028011 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:39.037179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-05b3c394-8d62-4daa-b07f-12ae11280676 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1309 microversion: 2.1 time: 0.081901 Oct 04 05:45:39.037949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 210/425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:38 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:39.159944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:39.160556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:39.167290 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:39.167768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:39.168204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:39.168898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:39.169342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:39.169763 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:39.409919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:39.419461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:39.421020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:39.422262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-adb60e4b-e37a-4088-b109-c9255739f742 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.266373 Oct 04 05:45:39.422825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 216/426] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:39 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:39.836414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:39.837232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:39.845439 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:39.846336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:39.846744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:39.847747 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:39.848355 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:39.849478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:39.854583 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:40.007416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:40.015408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-74babeac-15f5-49cf-aa78-969695e1321b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.183664 Oct 04 05:45:40.015973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 211/427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:39 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:40.065928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:40.066705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:40.085965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:40.086673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:40.087150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:40.088008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:40.088474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:40.088917 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:40.374648 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:40.385413 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b876736f-34f2-4fc6-bb95-2d7a1c2173e2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.328507 Oct 04 05:45:40.388089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 217/428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:40 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:40.452890 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:40.456755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:40.478657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:40.483964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:40.485092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:40.486129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:40.486833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:40.487477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:40.721180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:40.733199 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:40.735239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:40.736857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b3ccdb25-9216-4133-99bf-fb0634b8d7f8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.292583 Oct 04 05:45:40.754202 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 212/429] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:40 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:41.040141 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:41.041166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:41.048279 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:41.049145 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:41.049936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:41.051193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:41.051989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:41.052991 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:41.227670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:41.236366 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-762c180e-7f3d-44a9-a379-9a740e69ec74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.201105 Oct 04 05:45:41.237695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 218/430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:41 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:41.411852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:41.412479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:41.423239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:41.423743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:41.424189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:41.429207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:41.429207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:41.429207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:41.620222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:41.620222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3e6e0973-3d8c-49d0-acb7-8e91037f8a8a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.206676 Oct 04 05:45:41.620222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 213/431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:41 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:41.767336 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:41.767969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:41.775218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:41.775825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:41.776353 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:41.777062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:41.777550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:41.778042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:41.924246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:41.939097 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:41.940541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:41.941706 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-520387af-137f-47da-bb84-768deb8a4d7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.179099 Oct 04 05:45:41.942320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 219/432] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:41 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:42.260359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:42.261334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:42.267769 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:42.268244 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:42.268675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:42.269367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:42.269812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:42.270940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:42.401872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:42.411626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e44572dd-4279-455c-9a0d-00181e98536d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.155230 Oct 04 05:45:42.412214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 214/433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:42 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:42.710804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:42.712346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:42.719973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:42.724417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:42.724417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:42.724417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:42.724417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:42.724992 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:42.741047 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:42.859033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:42.868718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4fe58732-6054-4a34-b75a-069314b428f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.163544 Oct 04 05:45:42.869491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 220/434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:42 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:42.967079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:42.967670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:42.974507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:42.974987 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:42.975649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:42.976540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:42.977209 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:42.977852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:43.122093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:43.131330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:43.132778 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:43.133924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5f1328e5-6514-4bae-88f4-11d770b65209 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.171081 Oct 04 05:45:43.134506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 215/435] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:42 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:43.434889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:43.435420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:43.437654 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:43.442993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:43.450807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:43.450807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:43.450807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:43.450807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:43.451216 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:43.599800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:43.607675 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8a1e6626-db3a-485c-acb1-14d74d2d880e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.176677 Oct 04 05:45:43.617699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 221/436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:43 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:43.898391 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:43.899268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:43.901312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:43.907172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:43.913111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:43.913111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:43.913111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:43.913111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:43.913883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:44.042185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:44.050353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7434ecb8-5f8b-444c-858e-2afff25238a9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.158673 Oct 04 05:45:44.051029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 216/437] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:43 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:44.160712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:44.161487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:44.169178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:44.169818 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:44.170284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:44.170974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:44.171591 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:44.172013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:44.335032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:44.344184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:44.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:44.346819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a56683c6-7add-4dd7-b81c-97a20bd0906c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.191242 Oct 04 05:45:44.347597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 222/438] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:44 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:44.632253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:44.633167 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:44.639358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:44.639843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:44.640359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:44.641172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:44.641633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:44.642164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:44.787995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:44.796213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-886678f3-90d9-49d9-b48e-6b4fb4ad70b4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.169409 Oct 04 05:45:44.796929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 217/439] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:44 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:45.073539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:45.074066 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:45.076790 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=8 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:45.081670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:45.082178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:45.083123 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:45.083823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:45.084274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:45.084699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:45.220531 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:45.231202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fb4413f4-5b33-484b-a487-48d265783d62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.159430 Oct 04 05:45:45.231202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 223/440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:45 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:45.372080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:45.372685 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:45.379110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:45.379592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:45.380025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:45.380713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:45.381163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:45.381588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:45.523383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:45.536917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:45.538604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:45.539950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b513a905-3ef9-4954-81c0-56e56860a1e6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.171766 Oct 04 05:45:45.540899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 218/441] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:45 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:45.665227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1495467697", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "networks": [{"uuid": "3e667155-a3de-4a36-8e04-002d492ba4ce"}]}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:45.823113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:45.823830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:45.830230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:45.830749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:45.831187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:45.831895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:45.832359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:45.832921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:45.983668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:45.991809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-59637f4f-5905-433d-9d3c-ac2308de2f18 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.174980 Oct 04 05:45:45.992635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 219/442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:45 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:46.251886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:46.252447 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:46.258618 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:46.259102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:46.259539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:46.260233 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:46.260680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:46.261102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:46.403942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:46.414387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6c5f6c43-a52f-48ac-a66d-aabf2a785057 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.166450 Oct 04 05:45:46.424688 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 220/443] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:46 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:46.566492 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:46.567130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:46.573444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:46.573917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:46.575356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:46.576182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:46.576704 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:46.577127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:46.712900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:46.722127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:46.724391 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:46.725642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7f159cb8-00af-45f0-8d4f-10aa46dd5d38 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.163773 Oct 04 05:45:46.726677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 221/444] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:46 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:47.014954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:47.015671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:47.022828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:47.023403 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:47.024060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:47.024833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:47.025365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:47.025867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:47.156882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:47.169594 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7a0c2568-f40d-4d85-a64a-d77efbb9c9fb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.158655 Oct 04 05:45:47.170532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 222/445] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:47 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:47.438850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:47.439519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:47.446438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:47.446925 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:47.447362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:47.448052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:47.448505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:47.448929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:47.580079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:47.588301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-24cf0ce7-ade3-4d02-844c-7a6291580b47 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.153849 Oct 04 05:45:47.588873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 223/446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:47 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:47.750812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:47.751334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:47.757267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:47.757743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:47.758196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:47.758888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:47.759338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:47.759791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:47.895491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:47.904051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:47.905482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:47.906713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c6f8d9bf-f1b6-4866-a85e-e2353e56160e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.159902 Oct 04 05:45:47.907267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 224/447] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:47 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:48.192758 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:48.193368 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:48.199431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:48.199913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:48.200351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:48.201039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:48.201494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:48.201923 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:48.345598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:48.347663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-32abaaa6-00c5-412c-a07d-af13b7eea10e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.158751 Oct 04 05:45:48.349328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 225/448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:48 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:48.610347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:48.611960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:48.619195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:48.620145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:48.620807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:48.621811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:48.622624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:48.623216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:48.753462 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:48.762286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9816277d-341e-4532-847f-31c7377ef737 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.155726 Oct 04 05:45:48.763166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 226/449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:48 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:48.932575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:48.933183 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:48.939397 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:48.939878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:48.940314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:48.941000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:48.941454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:48.942565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.073588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:49.077197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:49.083816 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:49.086571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:49.086571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2dae9655-1408-4269-8fa3-e64928d3a811 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.157732 Oct 04 05:45:49.087066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 227/450] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:48 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:49.372166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:49.372824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:49.379387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:49.379866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:49.380505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.381005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:49.381438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:49.381860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.488348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] validate_networks() for [('3e667155-a3de-4a36-8e04-002d492ba4ce', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:45:49.507958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:49.515702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e09968eb-d6a0-4f6d-a74f-4cf0997dc59b tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.147408 Oct 04 05:45:49.522280 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 228/451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:49 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:49.784723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:49.786178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:49.792647 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:49.793128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:49.793557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.794266 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:49.794713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:49.795131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.831146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:45:49.831570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:45:49.832075 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:45:49.833025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:45:49.833433 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:45:49.842456 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:49.842944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:49.843385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.844111 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:49.844570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:49.844996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:49.862185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Getting quotas for project e003d2bea5f04ac7a70fd2b7d2ee1f91. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:45:49.866610 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Getting quotas for user 877575c9e0264241b9eab868a89cbbe8 and project e003d2bea5f04ac7a70fd2b7d2ee1f91. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:45:49.868902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:49.878393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:45:49.882812 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:45:49.922565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:49.930374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d54874cc-344f-4523-8c86-37570b721e6a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.149411 Oct 04 05:45:49.930900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 229/452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:49 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:50.043873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a5878ff0-a90b-4abb-8a1e-df3add57bc7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.382237 Oct 04 05:45:50.051247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 224/453] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:45:50.056157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d4851e1b-2e80-4e3a-b6f4-6b94530c9c10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:50.056908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d4851e1b-2e80-4e3a-b6f4-6b94530c9c10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:50.116040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:50.116745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:50.124885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:50.125677 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:50.126337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:50.134804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:50.136417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:50.136886 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:50.139902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d4851e1b-2e80-4e3a-b6f4-6b94530c9c10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:50.148625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d4851e1b-2e80-4e3a-b6f4-6b94530c9c10 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1219 microversion: 2.1 time: 0.096199 Oct 04 05:45:50.150989 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 230/454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:50 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:50.320463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:50.334419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:50.336865 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:50.339882 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-69d6d637-4316-4b82-92a4-03641c9f6d0f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.229176 Oct 04 05:45:50.341164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 225/455] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:50 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:45:50.539710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:50.540228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:50.546691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:50.547164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:50.547789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:50.548468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:50.548912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:50.549336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:50.688217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:50.696935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7dee394d-7ba6-49a3-88f3-9250bb077abb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.161668 Oct 04 05:45:50.697511 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 231/456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:50 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:50.954806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:50.956453 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:50.964924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:50.968377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:50.968377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:50.968377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:50.968871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:50.969332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:51.116303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:51.125159 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-641dc904-9b45-4ca7-bba3-86eec3bd6fa4 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.174127 Oct 04 05:45:51.145685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 226/457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:50 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:51.173626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7a0dd740-0621-4f4c-aaae-20bdbbe24028 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:51.174254 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a0dd740-0621-4f4c-aaae-20bdbbe24028 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:51.228954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7a0dd740-0621-4f4c-aaae-20bdbbe24028 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:51.239054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7a0dd740-0621-4f4c-aaae-20bdbbe24028 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1219 microversion: 2.1 time: 0.068603 Oct 04 05:45:51.239976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 232/458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:51 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:51.401043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:51.401643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:51.408358 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:51.413221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:51.413221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:51.413221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:51.413221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:51.413614 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:51.556191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:51.565814 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:51.567362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:51.568522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-db5d0bfd-11c2-4ccf-8264-04ecaa0d85ee tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.171502 Oct 04 05:45:51.569102 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 227/459] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:51 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:51.720759 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:51.721367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:51.728234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:51.739080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:51.739080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:51.739080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:51.739080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:51.739493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:51.896236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:51.904736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b6a934dd-6eeb-4899-b8b9-c771e75464af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.187816 Oct 04 05:45:51.905317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 233/460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:51 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:52.150900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:52.151907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:52.158481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.158960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.159394 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.160086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.161146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.161600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.264183 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:52.265092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:52.274798 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.275868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.276557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.284537 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.285487 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.286080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.327131 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:52.335879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c6e29834-359c-4b72-9fc8-5b86201d40d7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.189063 Oct 04 05:45:52.336445 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 228/461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:52 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:52.362665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:52.370501 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d7b4bcb3-bf1a-45d6-92b3-ca7a8a00fca6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.111427 Oct 04 05:45:52.371066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 234/462] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:52 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:52.595375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:52.596014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:52.602813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.603283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.603742 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.604432 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.604870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.605296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.769216 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:52.778013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:52.779529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:52.780678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cf6136ca-e8be-41a9-8c19-849421c4b96e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.189515 Oct 04 05:45:52.781230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 229/463] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:52 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:52.930157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:52.930782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:52.937069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.937556 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.937994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:52.939444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:52.939896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:52.940323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.073172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:53.083040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e6655f44-3911-4ea8-86ee-4c85830a43d2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.157309 Oct 04 05:45:53.084093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 235/464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:52 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:53.359595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:53.360183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:53.366651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:53.367734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:53.367834 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.368506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:53.368956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:53.369380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.395908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:53.396529 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:53.403073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:53.403636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:53.404282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.404985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:53.405437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:53.406081 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.481887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:53.490088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3d1838e3-03cc-4242-8c88-f5168939d547 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.099374 Oct 04 05:45:53.491246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 236/465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:53 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:53.539002 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:53.547426 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-34d10413-7933-4847-b6e9-e278e098e295 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.192270 Oct 04 05:45:53.554884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 230/466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:53 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:53.805767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:53.806352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:53.812653 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:53.813123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:53.813548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.814247 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:53.814691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:53.815103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:53.950288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:53.959408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:53.960866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:53.962045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-889ffc03-1489-4dca-b5b0-30c1dbe30b93 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.160331 Oct 04 05:45:53.962633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 237/467] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:53 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:54.106632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:54.107337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:54.115160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.115655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.116093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.117066 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.117740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.118192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.502785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:54.512779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:54.513387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:54.513538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c290b662-ab50-40f6-883c-5246eeaec5ee tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.410756 Oct 04 05:45:54.518740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 231/468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:54 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:54.522825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.523594 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.524256 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.525186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.525887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.526566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.571333 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:54.571935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:54.578584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.579075 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.579516 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.580221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.580669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.581090 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.608141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:54.616283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8e28f342-97a5-47c3-919b-40fb25e45ec8 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.107328 Oct 04 05:45:54.616853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 238/469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:54 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:54.720545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:54.728765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-18f5acc8-015b-4424-9773-b6d2757a39b2 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.161478 Oct 04 05:45:54.729528 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 232/470] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:54 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:54.987099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:54.987617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:54.993781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.994291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.994723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:54.995413 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:54.995855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:54.996273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.142724 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:55.152517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:55.153953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:55.155143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7da9198c-aca2-4f5b-aedc-82df224c91eb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.172001 Oct 04 05:45:55.162980 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 239/471] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:54 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:55.535998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:55.536664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:55.544479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:55.544967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:55.545404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.546115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:55.546588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:55.551760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.638969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:55.639569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:55.646487 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:55.646962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:55.647392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.648222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:55.648602 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:55.649020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.708340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:55.721453 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:55.729724 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fa824973-fa66-4ba5-82c0-59b65bfcff07 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.197395 Oct 04 05:45:55.731600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 233/472] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:55 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:55.732597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-efc4e976-f868-4900-9e06-fa0f2542deff tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.097334 Oct 04 05:45:55.733786 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 240/473] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:55 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:55.758807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:55.760340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:55.769771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:55.770403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:55.770944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.771734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:55.772279 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:55.772801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:55.907541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:55.920283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0ec05d39-c32e-44a5-9111-e69321fbe86c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.169544 Oct 04 05:45:55.921530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 234/474] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:55 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:56.181436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:56.182443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:56.189015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.189498 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.189928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.190653 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.191112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.191574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.326026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:56.336196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:56.337803 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:56.339016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-48935cba-c725-4c4d-8447-62e10bb6e81c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.161678 Oct 04 05:45:56.339762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 241/475] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:56 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:56.754463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:56.755078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:56.761463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.761934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.762409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.763124 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.763569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.763984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.773392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:56.773975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:56.781810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.782793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.783712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.784640 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.785461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.786103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.855646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:56.865485 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8a10580a-d1b6-43eb-9567-d0269b591ba4 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.095677 Oct 04 05:45:56.867110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 242/476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:56 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:56.908952 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:56.917093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b4543b6d-df3e-40ea-b58f-d64148f9b31a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.167078 Oct 04 05:45:56.917843 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 235/477] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:56 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:56.944933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:56.945536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:56.951599 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.952079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.952516 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:56.953201 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:56.953650 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:56.954075 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.088241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:57.095826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a631aa46-454f-4833-964f-bf4da4d916da tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.155299 Oct 04 05:45:57.096385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 243/478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:56 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:57.365310 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:57.365910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:57.371916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:57.372549 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:57.372912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.373688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:57.374151 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:57.374573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.509585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:57.519852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:57.523840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:57.523840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-844d9b60-134a-4893-b40b-2344436bcb90 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.161666 Oct 04 05:45:57.523840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 236/479] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:57 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:57.889443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:57.890341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:57.897025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:57.897559 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:57.898203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.899049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:57.899510 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:57.899958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.940117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:57.942685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:57.958429 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:57.958924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:57.959362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.960066 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:57.960517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:57.960942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:57.991761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:57.999589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7b2d8ce6-a0dd-42c4-b07c-418ffab5cbb2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.114448 Oct 04 05:45:58.000277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 244/480] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:57 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:45:58.110096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:58.114466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:58.120304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-13012275-71cc-40d3-84ed-7c2e9a360fb8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.184781 Oct 04 05:45:58.120884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 237/481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:57 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:58.123022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:58.124373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:58.135794 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:58.136251 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:58.136779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:58.137622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:58.138112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:58.138556 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:58.279994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:58.288571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6bcf0851-6c73-4704-bd5f-7c4ddb25553c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.170669 Oct 04 05:45:58.311822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 245/482] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:58 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:58.551649 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:58.552420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:58.558487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:58.558958 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:58.559386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:58.560058 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:58.560498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:58.561160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:58.727256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:58.727256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:58.727564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:58.727564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9ac65606-e772-45f7-8abc-9898a9e1d9d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.168535 Oct 04 05:45:58.727564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 238/483] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:58 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:45:59.025129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:59.025731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.032430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.032903 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.033331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.034009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.034481 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.034924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.052354 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:59.094602 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:59.102220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e7615a43-2939-4127-a660-a16383fcaf05 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1223 microversion: 2.1 time: 0.080835 Oct 04 05:45:59.102783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 246/484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:59 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:59.146591 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:59.147163 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.153488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.153965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.154433 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.155117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.155563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.155986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.282304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:59.290624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5415242f-61b5-4b62-9989-02e58b9b3daf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.148434 Oct 04 05:45:59.291598 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 239/485] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:59 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:59.312522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:59.313127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.320549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.321027 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.321765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.322248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.322698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.323216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.453210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:45:59.461567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-000d5b25-073d-464b-910a-1d285d74b402 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.152535 Oct 04 05:45:59.461567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 247/486] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:45:59 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:45:59.749886 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:59.750527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.756674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.765384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.765384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.765384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.765384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.765936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.808813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:59.809303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.815520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.816000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.816467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.817161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.817610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.818035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.842624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9be18fe3-a721-4bd6-9b20-883ae2f0ed09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/ips" status: 200 len: 149 microversion: 2.1 time: 0.037615 Oct 04 05:45:59.843811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 248/487] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:45:59 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:45:59.853231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:59.856640 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f3b3e25-5167-422c-87d0-f24fc3285750"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:45:59.859103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.868465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.868465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.868465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.868465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.869023 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.869023 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.874821 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=6 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:45:59.953679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Invalid volume: volume 1f3b3e25-5167-422c-87d0-f24fc3285750 is already attached to instances: 71aa646b-022b-46dc-a362-fe7d63d90f5a Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: POST /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/os-volume_attachments HTTP/1.1 Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 74 Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:45:59.955353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {"volumeAttachment": {"volumeId": "1f3b3e25-5167-422c-87d0-f24fc3285750"}} Oct 04 05:45:59.956990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Invalid volume: volume 1f3b3e25-5167-422c-87d0-f24fc3285750 is already attached to instances: 71aa646b-022b-46dc-a362-fe7d63d90f5a Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'server_id': 'afc490d5-7739-416e-8f18-375de3166471', 'body': {'volumeAttachment': {'volumeId': '1f3b3e25-5167-422c-87d0-f24fc3285750'}}} Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1f3b3e25-5167-422c-87d0-f24fc3285750 is already attached to instances: 71aa646b-022b-46dc-a362-fe7d63d90f5a Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:59.957969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1f3b3e25-5167-422c-87d0-f24fc3285750 is already attached to instances: 71aa646b-022b-46dc-a362-fe7d63d90f5a Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:45:59.959458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1f3b3e25-5167-422c-87d0-f24fc3285750 is already attached to instances: 71aa646b-022b-46dc-a362-fe7d63d90f5a Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 400 to user: Invalid volume: volume 1f3b3e25-5167-422c-87d0-f24fc3285750 is already attached to instances: 71aa646b-022b-46dc-a362-fe7d63d90f5a {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:45:59.961029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0b040b07-b004-4e01-9dff-9bcf1536b24d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104594 Oct 04 05:45:59.961580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 249/488] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:45:59 2022] POST /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:45:59.966047 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:45:59.966621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:45:59.972962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.973457 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.973894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:45:59.974629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:45:59.978827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:45:59.978827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.001346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:46:00.010308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.020001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.021761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.023096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-38cbaa4c-6e96-4836-a772-8627ac5d4033 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.277081 Oct 04 05:46:00.023663 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 240/489] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:45:59 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:00.124817 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:00.125401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:00.131963 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.132439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.132883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.133560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.134027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.134460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.194686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.202400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d7101cf7-bf9d-41c0-998a-6b3e39d9805d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1215 microversion: 2.1 time: 0.081874 Oct 04 05:46:00.202961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 241/490] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:00 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:00.243458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-bff715a6-8fa2-4eb4-ac13-15dfe915d489 req-b157722b-5e97-4fe7-8b9a-1207776cd456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:00.254609 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-bff715a6-8fa2-4eb4-ac13-15dfe915d489 req-b157722b-5e97-4fe7-8b9a-1207776cd456 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.256078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-bff715a6-8fa2-4eb4-ac13-15dfe915d489 req-b157722b-5e97-4fe7-8b9a-1207776cd456 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.256829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-bff715a6-8fa2-4eb4-ac13-15dfe915d489 req-b157722b-5e97-4fe7-8b9a-1207776cd456 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.278631 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-bff715a6-8fa2-4eb4-ac13-15dfe915d489 req-b157722b-5e97-4fe7-8b9a-1207776cd456 service nova] Creating event network-changed:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:46:00.283484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-bff715a6-8fa2-4eb4-ac13-15dfe915d489 req-b157722b-5e97-4fe7-8b9a-1207776cd456 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043855 Oct 04 05:46:00.284225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 242/491] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:00.313606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:00.314359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:00.321202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.321678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.322120 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.322827 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.323273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.323698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.342924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-682bf4ec-50df-42ed-91fb-9d27b5cd6e94 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 204 len: 0 microversion: 2.1 time: 0.380256 Oct 04 05:46:00.343473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 250/492] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:45:59 2022] DELETE /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:46:00.361904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:00.362664 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:00.376002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.376730 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.377545 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.378697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.380012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.380588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.486280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.494035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9dbea1c5-a19c-4cdc-b9e1-00a7a0908312 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.184717 Oct 04 05:46:00.494698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 243/493] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:00 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:00.499196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:00.499874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:00.507254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.507808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.508257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.508956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:00.509411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:00.509944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:00.522554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.530215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1e5c7563-e2ef-42f1-bf0d-fa4e70059b6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1681 microversion: 2.1 time: 0.177470 Oct 04 05:46:00.530788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 251/494] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:00 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:00.636415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:00.643782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8a0b109f-4f64-404c-88b3-d09c35b1f491 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.148164 Oct 04 05:46:00.644982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 244/495] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:00 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:01.048880 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:01.049429 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:01.056433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.056913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.057347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.058029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.058512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.058935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.189643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.198084 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.199536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.200668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1e13fa88-ea33-4b4b-a176-41256d6371cd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.155844 Oct 04 05:46:01.201214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 252/496] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:01 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:01.226377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:01.226981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:01.233331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.233816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.234295 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.234976 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.235418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.235838 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.296481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.304690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2f24269f-ea39-49ae-a553-c9739f11bcaa tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1215 microversion: 2.1 time: 0.082674 Oct 04 05:46:01.305194 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 245/497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:01 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:01.517161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:01.517790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:01.520241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=4 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:01.525060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.525542 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.525981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.526701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.527157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.527585 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.552374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:01.553000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:01.559163 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.559576 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.560009 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.560733 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.561560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.561989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.662031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.666377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8556f9c6-2f71-4e38-9420-976bdfa4e80d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.152997 Oct 04 05:46:01.681383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 253/498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:01 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:01.681383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:01.681383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:01.681383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.681847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.681847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.681847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:01.681847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:01.682133 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:01.689272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.696894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c0400c78-bdc7-47cc-bade-1668f8592f24 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1681 microversion: 2.1 time: 0.148430 Oct 04 05:46:01.705357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 246/499] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:01 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:01.812155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:01.819814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-65a1ec08-6188-40cc-b4b6-a5a345d4a2de tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.151773 Oct 04 05:46:01.825744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 254/500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:01 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:02.225704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:02.226321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:02.232673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.233230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.233557 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.234255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.234699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.235116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.327547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:02.328155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:02.331620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:02.335037 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.335557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.335992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.336693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.337144 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.337574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.364436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.373042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.374504 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.379300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1e524791-596b-40cd-8edd-85386c0d17aa tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.153971 Oct 04 05:46:02.379300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 247/501] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:02 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:02.398805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.406268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-86c172d3-29fa-4636-9b47-ad4bd68d0c7f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1271 microversion: 2.1 time: 0.082569 Oct 04 05:46:02.406828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 255/502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:02 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:02.688917 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:02.689515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:02.695708 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.696183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.696613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.697288 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.697727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.698160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.721009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:02.721743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:02.728626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.729192 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.729686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.730463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.730972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.731454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.838024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.845965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d20405fc-889b-4eaa-a106-096c382c9dda tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.161091 Oct 04 05:46:02.846622 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 248/503] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:02 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:02.851956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:02.852631 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:02.859309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.859861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.860364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.861116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:02.861633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:02.862055 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:02.872826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.880805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ec0cf3b4-09a0-44dc-b3f3-e6571128e6c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1681 microversion: 2.1 time: 0.163955 Oct 04 05:46:02.881361 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 256/504] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:02 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:02.991559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:02.999348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c7bba627-1ab0-47ae-bda8-46872aff48cd tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.151801 Oct 04 05:46:02.999908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 249/505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:02 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:03.401338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:03.402205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:03.411060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.411530 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.412326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.413261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.413917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.415257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.429110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:03.429922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:03.438438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.439252 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.439852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.440874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.441880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.442866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.507328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:03.515176 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-71c368d3-46b2-4767-a30f-28f1a6d7a2d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1271 microversion: 2.1 time: 0.090701 Oct 04 05:46:03.515735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 250/506] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:03 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:03.559028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:03.568259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:03.575039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:03.575039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6aa44a61-f949-4c2c-ad40-e9dfbc5b0112 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.173441 Oct 04 05:46:03.575039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 257/507] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:03 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:46:03.869411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:03.870049 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:03.880220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.880710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.881152 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.881858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.882352 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.882780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.904994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:03.905748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:03.911863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.912455 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.912990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:03.913774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:03.914356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:03.915203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.064893 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.073281 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6f959dd4-0861-4d77-83bc-8178c17ecc19 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1681 microversion: 2.1 time: 0.173020 Oct 04 05:46:04.073964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 258/508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:03 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:04.078642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:04.079500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:04.094747 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:04.095534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:04.096189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.097101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:04.097755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:04.098426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.243290 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.256974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dac76c2f-67d3-46f8-aa31-bbf489a8d4af tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.391386 Oct 04 05:46:04.270173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 251/509] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:03 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:04.276766 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.282625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-93c65d60-0152-4a13-a3b2-db7c3c77aa66 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.207530 Oct 04 05:46:04.283367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 259/510] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:04 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:04.539312 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:04.539849 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:04.546365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:04.546853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:04.547293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.547993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:04.548443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:04.548865 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.599740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:04.600344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:04.606738 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:04.607214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:04.607752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.608311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:04.608757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:04.609181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:04.610722 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.618374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cc051a6b-44cd-4748-b4e5-771d25aae604 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1271 microversion: 2.1 time: 0.083743 Oct 04 05:46:04.618942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 252/511] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:04 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:04.738995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.747694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.749149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:04.750325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-affd3c75-7589-460a-803c-c05d7298a87f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.155304 Oct 04 05:46:04.750886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 260/512] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:04 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:46:05.032462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-d1089bd0-b7c5-423f-95f6-c065c3f7cd76 req-95b715c4-4cc2-4d9c-ab6f-720160e1df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc490d5-7739-416e-8f18-375de3166471", "name": "network-vif-deleted", "tag": "6b6831aa-36d6-46ef-9ebe-9d092eae8cf3"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:05.041915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-d1089bd0-b7c5-423f-95f6-c065c3f7cd76 req-95b715c4-4cc2-4d9c-ab6f-720160e1df33 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.042413 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-d1089bd0-b7c5-423f-95f6-c065c3f7cd76 req-95b715c4-4cc2-4d9c-ab6f-720160e1df33 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.042838 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-d1089bd0-b7c5-423f-95f6-c065c3f7cd76 req-95b715c4-4cc2-4d9c-ab6f-720160e1df33 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.053926 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-d1089bd0-b7c5-423f-95f6-c065c3f7cd76 req-95b715c4-4cc2-4d9c-ab6f-720160e1df33 service nova] Creating event network-vif-deleted:6b6831aa-36d6-46ef-9ebe-9d092eae8cf3 for instance afc490d5-7739-416e-8f18-375de3166471 on hv-cinder-84914 Oct 04 05:46:05.059098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-d1089bd0-b7c5-423f-95f6-c065c3f7cd76 req-95b715c4-4cc2-4d9c-ab6f-720160e1df33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Oct 04 05:46:05.059761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 253/513] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:05.104977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:05.105588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.111674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.112151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.112589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.113504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.113979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.115051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.184225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:05.188183 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:05.194543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-88b7fb9e-bac7-423b-a7aa-dc79a2e208c2 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1613 microversion: 2.1 time: 0.093201 Oct 04 05:46:05.195082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 261/514] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:05 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:05.286105 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:05.287360 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.294440 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.295286 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.296162 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.297067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.297523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.297950 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.333624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:05.334112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.344312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.346021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.346548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.347326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.347785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.348215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.542253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:05.556741 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-aaf84bb9-4e04-4488-afbb-c1d22cb8a393 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.226951 Oct 04 05:46:05.557761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 262/515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:05 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:05.641021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:05.641647 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.652563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.653500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.653949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.654719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.655179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.657092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.667636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:05.677396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-84e93347-f512-46f9-a4bf-d3c0c0815ab2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1501 microversion: 2.1 time: 0.396003 Oct 04 05:46:05.682200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 254/516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:05 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1501 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:05.703196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "610caf36-3911-41e9-94d4-d19cad0f696d"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:05.706258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.730349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.737419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.741289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.742719 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.745014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.745740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.780512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:05.791867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c2e5a1a4-87ec-40d1-8f55-fae0a4a2ca24 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1271 microversion: 2.1 time: 0.154653 Oct 04 05:46:05.802998 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 263/517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:05 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:05.806292 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] HTTP exception thrown: Cannot 'attach_volume' instance f27eb826-a49d-4d1d-a843-cc725fae592b while it is in vm_state rescued Oct 04 05:46:05.818963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:05.820382 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Request method failure captured: Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/os-volume_attachments HTTP/1.1 Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 74 Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8gw41q9dwS_KnobwoDRNzhRJFIsISD2v3S5ulTMXUx99p89WzzUPyTq164ojGmXyTNImVDrM33A2S1oGuxmLS6UEjkrhDk23xPZf130OIwZNI6AUJFHJHKumSPZmuNeiOmQGJnVC4jSFiG1TWA_V9v-Mk5QSoUeuaPLSaNwHKT78_Q Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:46:05.820783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_689c4759cb5943b79f2637a8e29e230e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}] Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c1b48a973c20470a9af23c77e3da5b72 Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {"volumeAttachment": {"volumeId": "610caf36-3911-41e9-94d4-d19cad0f696d"}} Oct 04 05:46:05.822457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Cannot 'attach_volume' instance f27eb826-a49d-4d1d-a843-cc725fae592b while it is in vm_state rescued Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'server_id': 'f27eb826-a49d-4d1d-a843-cc725fae592b', 'body': {'volumeAttachment': {'volumeId': '610caf36-3911-41e9-94d4-d19cad0f696d'}}} Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f27eb826-a49d-4d1d-a843-cc725fae592b in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:46:05.823424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f27eb826-a49d-4d1d-a843-cc725fae592b while it is in vm_state rescued Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:05.825484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f27eb826-a49d-4d1d-a843-cc725fae592b while it is in vm_state rescued Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Returning 409 to user: Cannot 'attach_volume' instance f27eb826-a49d-4d1d-a843-cc725fae592b while it is in vm_state rescued {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a3cbdb52-3f94-427d-9376-4a71999610a5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.123405 Oct 04 05:46:05.829822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 255/518] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:46:05 2022] POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/os-volume_attachments => generated 152 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 05:46:05.835829 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.837486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.837940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.838700 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.839163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.839597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.840764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:05.841473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:05.851472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.857633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.857633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.857633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:05.857633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:05.858069 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:05.859016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:06.039140 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.048181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.049684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.050978 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d4e9c8d2-8542-4d5e-8b2f-8ae4e888bf72 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.246566 Oct 04 05:46:06.051539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 264/519] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:05 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:06.175200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b11b5aab-7423-4701-863b-798a5d5a53b7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/action" status: 202 len: 0 microversion: 2.1 time: 0.340764 Oct 04 05:46:06.176043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 256/520] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:46:05 2022] POST /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:06.184662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:06.185365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:06.192025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.192599 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.197807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.197807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.197807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.197807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.221395 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:06.226777 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:06.232755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.233423 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.234019 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.235328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.236184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.236823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.301679 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.302702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.303921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.303921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid afc490d5-7739-416e-8f18-375de3166471 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:06.385074 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.396018 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c28f8754-da2b-4cdc-84e4-ba01cb378934 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1331 microversion: 2.1 time: 0.178814 Oct 04 05:46:06.399158 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 257/521] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:06 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1331 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:06.404104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.416554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-39825953-39e6-464f-8637-26a96213c421 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1509 microversion: 2.1 time: 0.235991 Oct 04 05:46:06.417493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 265/522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:06 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:06.580376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:06.580991 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:06.588222 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.588702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.589136 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.589831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.590459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.590747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.774770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.782593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9f21d6e1-3f53-4925-a0de-7bc2dd73e998 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.206086 Oct 04 05:46:06.783162 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 258/523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:06 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:06.821351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:06.821953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:06.828641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.829268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.829698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.830432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:06.830883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:06.831363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:06.973287 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:06.981053 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3de6fe16-fd06-454a-95fe-26d53cf7b7be tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.163622 Oct 04 05:46:06.981622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 266/524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:06 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:07.075782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:07.076383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:07.083224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.083711 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.084152 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.084839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.085286 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.085712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.217033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:07.227522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:07.229128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:07.230442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f7800711-1200-4a3f-84b9-5c1e027227e1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.158595 Oct 04 05:46:07.231117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 259/525] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:07 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:07.422647 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:07.423238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:07.430416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.430894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.431329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.432010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.432460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.432884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.440369 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:07.440986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:07.446957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.447445 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.448424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.448615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.449029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.449458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.463942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.464471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.464851 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.465298 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid afc490d5-7739-416e-8f18-375de3166471 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:07.506451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:07.518512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ea14a998-bfa0-41d7-8dd2-bf05753042e0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1331 microversion: 2.1 time: 0.098359 Oct 04 05:46:07.525178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 267/526] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:07 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:07.646250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:07.653972 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c005a982-d1b6-484a-9aaa-cd783b08cb39 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1509 microversion: 2.1 time: 0.218051 Oct 04 05:46:07.654571 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 260/527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:07 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:07.804889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:07.805522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:07.811866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.812339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.812768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.813447 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:07.813894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:07.814370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:07.954874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:07.963706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6c9d2756-e2d8-45ef-bc23-f82ded8e9b62 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.162556 Oct 04 05:46:07.964289 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 268/528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:07 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:08.005579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:08.006480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:08.012468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.012955 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.013393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.014093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.014579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.015006 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.241524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:08.249206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-39d62092-ad19-4d27-b7c0-14cd374a9b5d tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.248153 Oct 04 05:46:08.249856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 261/529] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:07 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:08.262579 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:08.263231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:08.269731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.270300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.270732 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.271414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.271880 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.272300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.400246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:08.408855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:08.410333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:08.412809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-636e6c62-f45a-45db-8851-fc8b03e8010f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.152895 Oct 04 05:46:08.412809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 269/530] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:08 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:46:08.448307 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-c63a2d52-646d-42e4-9051-b3dee3dbb9a9 req-a9033ed9-2a1b-4761-8aa6-188d97433c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fda981d-f498-4476-be14-b2b88a990533", "tag": "2e2c203f-0112-4068-8b70-eca7f47e4da8"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:08.458625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-c63a2d52-646d-42e4-9051-b3dee3dbb9a9 req-a9033ed9-2a1b-4761-8aa6-188d97433c7a service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.459097 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-c63a2d52-646d-42e4-9051-b3dee3dbb9a9 req-a9033ed9-2a1b-4761-8aa6-188d97433c7a service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.459526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-c63a2d52-646d-42e4-9051-b3dee3dbb9a9 req-a9033ed9-2a1b-4761-8aa6-188d97433c7a service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.471397 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-c63a2d52-646d-42e4-9051-b3dee3dbb9a9 req-a9033ed9-2a1b-4761-8aa6-188d97433c7a service nova] Creating event network-changed:2e2c203f-0112-4068-8b70-eca7f47e4da8 for instance 3fda981d-f498-4476-be14-b2b88a990533 on hv-cinder-84914 Oct 04 05:46:08.476134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-c63a2d52-646d-42e4-9051-b3dee3dbb9a9 req-a9033ed9-2a1b-4761-8aa6-188d97433c7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031600 Oct 04 05:46:08.476792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 262/531] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:08.541894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:08.542528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:08.548973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.549444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.549873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.551088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.551536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.551952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.582749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.583192 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.583629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.584074 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid afc490d5-7739-416e-8f18-375de3166471 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:08.624550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:08.633138 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7c1f12a6-87fb-43a6-820c-8b02d746f5f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 200 len: 1331 microversion: 2.1 time: 0.095066 Oct 04 05:46:08.636217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 270/532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:08 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:08.680139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:08.681374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:08.687442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.687917 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.688396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.689077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.689521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.689944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.825389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:08.836529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7567a6a8-ddfe-4131-bef0-4408f33badfa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1509 microversion: 2.1 time: 0.158805 Oct 04 05:46:08.836529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 263/533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:08 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:08.986860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:08.987466 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:08.993944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.994456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.994901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:08.995593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:08.996045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:08.996532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.148035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:09.155630 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2b316d0e-91b6-496b-9d21-2a425a87a85f tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.172632 Oct 04 05:46:09.156188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 271/534] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:08 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:09.273603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:09.274072 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:09.282155 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.282633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.283059 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.283749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.284219 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.285442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.436725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:09.437329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:09.444278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.444763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.445196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.445889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.446387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.446922 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.555524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:09.563830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a9c14bdd-dfe1-45f0-9029-364cdf9a16ae tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.295092 Oct 04 05:46:09.564667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 264/535] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:09 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:09.600079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:09.608608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:09.610048 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:09.611242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-81e32312-aa4d-458f-8a32-17750ee29c10 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.178959 Oct 04 05:46:09.611790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 272/536] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:09 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:46:09.655973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:09.656574 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:09.662542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.663020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.663447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.664127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.664578 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.665002 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.678593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 HTTP/1.1 Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:46:09.680201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:46:09.681704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'afc490d5-7739-416e-8f18-375de3166471'} Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:46:09.688081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:46:09.689519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:09.691309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:46:09.691309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e9bc6e9c-21aa-4db1-bdec-813fe8bd5fb6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 404 len: 111 microversion: 2.1 time: 0.029535 Oct 04 05:46:09.691309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 265/537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:09 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:46:09.696433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1b5ab625-ecc1-4648-981e-8c026541fb0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '.version_select at 0x7f04865c3310>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:09.772046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1b5ab625-ecc1-4648-981e-8c026541fb0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021383007" status: 202 len: 0 microversion: 2.1 time: 0.079331 Oct 04 05:46:09.772597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 273/538] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 05:46:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021383007 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:09.856786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:09.858299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:09.865201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.865920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.866540 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:09.867403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:09.868015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:09.868432 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.146429 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:10.154588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eceac3b9-72ae-467a-a0e3-34afaa88cb81 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1509 microversion: 2.1 time: 0.301565 Oct 04 05:46:10.155248 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 266/539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:09 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:10.180875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:10.181844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:10.190108 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.190879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.191638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.192566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.193161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.193764 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.398791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:10.406780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-36447fb6-7ba2-4d55-8197-39ca761181c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.231148 Oct 04 05:46:10.407590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 274/540] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:10 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:10.587471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:10.588071 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:10.594156 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.594641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.595073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.595784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.596230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.596889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.641827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:10.643290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:10.654300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.655885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.656637 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.657937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.658817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.660229 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.734477 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:10.742463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-351e3a5f-ed58-4605-a26b-e1e02348db77 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.158764 Oct 04 05:46:10.757615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 267/541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:10 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:10.762811 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:10.763483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:10.773796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.773796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.773796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.773796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:10.774225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:10.774225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:10.807200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:10.817305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:10.819479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:10.820617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8e2d70e2-f47a-430c-bc8d-4b471c568fd2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.186239 Oct 04 05:46:10.821503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 275/542] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:10 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:10.859013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'services' on Instance uuid 71aa646b-022b-46dc-a362-fe7d63d90f5a {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:10.995806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-1529a205-43d9-469b-a967-af292d8133fc req-6198875e-ef55-47c2-8ede-0e87d566346f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "name": "network-vif-plugged", "status": "completed", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:11.005943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1529a205-43d9-469b-a967-af292d8133fc req-6198875e-ef55-47c2-8ede-0e87d566346f service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.006579 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1529a205-43d9-469b-a967-af292d8133fc req-6198875e-ef55-47c2-8ede-0e87d566346f service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.007074 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-1529a205-43d9-469b-a967-af292d8133fc req-6198875e-ef55-47c2-8ede-0e87d566346f service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.017962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-1529a205-43d9-469b-a967-af292d8133fc req-6198875e-ef55-47c2-8ede-0e87d566346f service nova] Creating event network-vif-plugged:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:46:11.024216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-1529a205-43d9-469b-a967-af292d8133fc req-6198875e-ef55-47c2-8ede-0e87d566346f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Oct 04 05:46:11.024960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 276/543] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:11.078266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-488e159f-d270-4c07-b215-f0e46499d35c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments/1f3b3e25-5167-422c-87d0-f24fc3285750" status: 202 len: 0 microversion: 2.1 time: 0.319078 Oct 04 05:46:11.078874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 268/544] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:46:10 2022] DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments/1f3b3e25-5167-422c-87d0-f24fc3285750 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:11.088184 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:11.091087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:11.097288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.097761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.098211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.098900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.099387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.099806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.129460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-54b420b8-ca0c-4192-af3e-428f60a0c9b4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Oct 04 05:46:11.130274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 277/545] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:46:11 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:11.178912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:11.179534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:11.185716 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.186475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.186908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.187587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.188030 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.188448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.313563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:11.321753 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-70e27891-eeab-4fdf-b1f1-94859004c01c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1509 microversion: 2.1 time: 0.147085 Oct 04 05:46:11.322337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 269/546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:11 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:11.431165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:11.431701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:11.437767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.438300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.438736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.439593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.440046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.440470 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.566206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:11.573371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-11cf791d-2a81-4b05-987f-0a45d1708685 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.146097 Oct 04 05:46:11.573934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 278/547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:11 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:11.764963 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:11.765521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:11.767892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:11.772558 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.773034 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.773462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.774160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.774601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.775017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.846278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:11.847813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:11.856143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.856702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.857253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.858113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:11.858654 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:11.859151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:11.888692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:11.974962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:11.986045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a487c07c-0daf-42fc-8107-95cf32064402 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.224962 Oct 04 05:46:11.986691 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 270/548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:11 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:12.008712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:12.017216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:12.019148 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:12.020304 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8841f031-7817-466f-93ce-807547051b1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.178056 Oct 04 05:46:12.020857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 279/549] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:11 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:46:12.141996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:12.144761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:12.150738 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:12.151243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:12.151642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:12.152324 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:12.152761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:12.153179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:12.182475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-74fbafec-626c-4237-9b65-02ce0dd04761 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044347 Oct 04 05:46:12.183042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 271/550] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:46:12 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:12.344239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:12.344864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:12.351536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:12.352007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:12.352436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:12.353111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:12.353554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:12.353971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:12.478631 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:12.486246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d5f51f60-98bf-4d91-b9d3-ac5fe70cd2c8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1509 microversion: 2.1 time: 0.146199 Oct 04 05:46:12.486804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 280/551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:12 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:12.596107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:12.596642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:12.602587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:12.603065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:12.603501 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:12.604195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:12.604645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:12.605067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:12.608935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:12.786846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:12.796084 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8e7b912b-7c86-4cf6-a269-e04e09041732 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.204390 Oct 04 05:46:12.796664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 272/552] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:12 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:13.011565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:13.012174 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:13.018699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.019182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.019621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.020310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.020764 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.021218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.037735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-0b2d82e8-ad85-4c8f-bb59-78bb2fe70663 req-2f8d7613-d51f-4963-95e3-d342ee9b965d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "name": "network-vif-plugged", "status": "completed", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:13.047234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0b2d82e8-ad85-4c8f-bb59-78bb2fe70663 req-2f8d7613-d51f-4963-95e3-d342ee9b965d service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.047738 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0b2d82e8-ad85-4c8f-bb59-78bb2fe70663 req-2f8d7613-d51f-4963-95e3-d342ee9b965d service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.048172 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-0b2d82e8-ad85-4c8f-bb59-78bb2fe70663 req-2f8d7613-d51f-4963-95e3-d342ee9b965d service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.060062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-0b2d82e8-ad85-4c8f-bb59-78bb2fe70663 req-2f8d7613-d51f-4963-95e3-d342ee9b965d service nova] Creating event network-vif-plugged:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:46:13.067954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-0b2d82e8-ad85-4c8f-bb59-78bb2fe70663 req-2f8d7613-d51f-4963-95e3-d342ee9b965d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Oct 04 05:46:13.068545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 273/553] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:13.073540 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:13.074250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:13.080324 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.080798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.081233 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.081913 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.082422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.082848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.151439 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:13.159225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-23e54b00-4149-4252-a888-0ae4e40f8fb6 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.151632 Oct 04 05:46:13.159795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 281/554] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:13 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:13.195018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:13.197306 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:13.203238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.203712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.204144 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.204826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.205274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.205692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.210414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:13.219022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:13.220475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:13.221629 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ca0a9ab8-a446-45dd-9f46-0cca24f0156f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.152025 Oct 04 05:46:13.222210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 274/555] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:13 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:13.235168 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6b75d71d-e617-438b-9068-9bf26b27a942 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Oct 04 05:46:13.235716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 282/556] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:46:13 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:13.508890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:13.509430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:13.515546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.516024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.516456 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.517140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.517588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.518010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.643684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:13.652039 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e0b534f8-078d-4173-9d5f-e7ba5c10e129 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1515 microversion: 2.1 time: 0.147108 Oct 04 05:46:13.652600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 275/557] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:13 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:13.819971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:13.820502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:13.826700 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.830911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.830911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.830911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:13.830911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:13.831278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:13.960344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:13.967991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2c84b3ab-b6c3-4f10-bf14-ed794bf591ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.152035 Oct 04 05:46:13.968639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 283/558] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:13 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:14.182856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:14.183569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:14.193533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.194017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.194683 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.195395 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.202020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.202020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.248316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:14.248916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:14.260276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.261110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.261899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.262785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.263259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.263679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.336153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:14.343996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-033abd24-de27-4cfe-a51f-98223e0c0125 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.165846 Oct 04 05:46:14.344570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 276/559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:14 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:14.358309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:14.358309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:14.360803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.361283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.361717 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.362444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.362896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.363847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.394640 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9d517c7c-e583-45f1-9e7b-c52800687b89 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Oct 04 05:46:14.395213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 277/560] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:46:14 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:14.400135 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:14.409191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:14.410716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:14.411866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-209743ef-5f15-4d0e-9f20-136412e50702 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.167785 Oct 04 05:46:14.412417 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 284/561] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:14 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:14.991200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:14.991744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:14.997809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.998343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:14.998780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:14.999464 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:14.999912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.000335 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.132089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:15.139761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1495dff1-5f3c-48f7-96ca-6de55903d7ce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.153196 Oct 04 05:46:15.140353 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 278/562] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:14 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:15.271421 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-23b07c7b-6d41-49fd-8311-766b96e0a49a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'create', calling method: .version_select at 0x7f04866daa60>, body: {"keypair": {"name": "tempest-keypair-683898245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMS28Fw73qO7ApylPdmoyhNt44kRYEHe7gtW7/fe7hihqicbpaYO3CUaU/b3WMgl/si2la8+zLmjmlzhe7iT6FV0/J3weBnHMIzy31jCwm1O8L33FOmxSryKMA7TeoY8eg=="}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:15.287529 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-23b07c7b-6d41-49fd-8311-766b96e0a49a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for project 689c4759cb5943b79f2637a8e29e230e. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:46:15.291310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-23b07c7b-6d41-49fd-8311-766b96e0a49a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for user c1b48a973c20470a9af23c77e3da5b72 and project 689c4759cb5943b79f2637a8e29e230e. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:46:15.367667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:15.368261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:15.375167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.375939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.377028 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.377819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.377944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-23b07c7b-6d41-49fd-8311-766b96e0a49a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110643 Oct 04 05:46:15.378184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.384976 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.387978 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 285/563] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:46:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:15.410338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:15.416122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:15.427788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.428454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.429126 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.430503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.435641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.436766 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.468428 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e16145ce-c067-4350-b481-2761b004ec85 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065850 Oct 04 05:46:15.469303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 286/564] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:46:15 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:15.474196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:15.474680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:15.482300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.483119 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.483729 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.484838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.485438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.486009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.581685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:15.590659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-79f42850-8fa9-4fb4-b0fc-4d09774f3d14 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.226782 Oct 04 05:46:15.592084 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 279/565] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:15 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:15.598529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:15.599417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:15.606230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.607017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.607652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.609799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:15.610526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:15.611379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:15.646203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'services' on Instance uuid fb8f1069-3555-4673-a945-1e45b7a35999 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:15.749204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:15.758583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:15.760032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:15.761193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f4468c21-21f0-4eb3-94e0-1cc10397f59d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.167993 Oct 04 05:46:15.761758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 280/566] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:15 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:15.878695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-113197af-0fa7-4a5d-bd6b-9badf8e2eae2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-volume_attachments/a14f4d0c-83e9-486f-933d-119984f58f59" status: 202 len: 0 microversion: 2.1 time: 0.407962 Oct 04 05:46:15.879944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 287/567] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:46:15 2022] DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-volume_attachments/a14f4d0c-83e9-486f-933d-119984f58f59 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:16.164581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:16.165191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:16.171813 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.172299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.172726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.173449 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.174038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.174510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.316854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:16.324630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-add7cc76-8def-4372-ac4d-087b929cb716 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1357 microversion: 2.1 time: 0.165226 Oct 04 05:46:16.325199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 281/568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:16 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:16.481365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:16.483605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:16.490996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.491476 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.491915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.492598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.493045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.493465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.522543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8e6789b9-2114-4656-bd1c-03f0f077308e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045485 Oct 04 05:46:16.523100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 288/569] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:46:16 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:46:16.586922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:16.587461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:16.593892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.594409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.594844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.595537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.595985 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.596413 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.620506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:16.620506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:16.622788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:46:16.624729 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.625229 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.625910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.627005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.627465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.627891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.839968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:16.851092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e0114d21-40c8-4a18-a4c5-e3db42b983bc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.238257 Oct 04 05:46:16.852329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 289/570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:16 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:16.857200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:16.857794 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:16.864072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.864552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.865728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.865872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.866258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.866825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.919330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8f1a61fe-5736-4265-9877-18ddc1405ead tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 204 len: 0 microversion: 2.1 time: 0.335919 Oct 04 05:46:16.920171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 282/571] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:46:16 2022] DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 05:46:16.929314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:16.930502 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:16.937416 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.938018 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.938625 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:16.939402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:16.939923 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:16.940979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.090243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.098573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a3d85771-2feb-456e-aa93-49a604b19877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1680 microversion: 2.1 time: 0.173528 Oct 04 05:46:17.099253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 283/572] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:16 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:17.107450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-26cd7b30-9a2d-4e7a-8864-18fb459c0a0d req-c4c27d36-807c-49d0-aa0c-4c924795b10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fda981d-f498-4476-be14-b2b88a990533", "name": "network-vif-plugged", "status": "completed", "tag": "2e2c203f-0112-4068-8b70-eca7f47e4da8"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:17.117113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-26cd7b30-9a2d-4e7a-8864-18fb459c0a0d req-c4c27d36-807c-49d0-aa0c-4c924795b10a service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.117582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-26cd7b30-9a2d-4e7a-8864-18fb459c0a0d req-c4c27d36-807c-49d0-aa0c-4c924795b10a service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.118004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-26cd7b30-9a2d-4e7a-8864-18fb459c0a0d req-c4c27d36-807c-49d0-aa0c-4c924795b10a service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.129667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-26cd7b30-9a2d-4e7a-8864-18fb459c0a0d req-c4c27d36-807c-49d0-aa0c-4c924795b10a service nova] Creating event network-vif-plugged:2e2c203f-0112-4068-8b70-eca7f47e4da8 for instance 3fda981d-f498-4476-be14-b2b88a990533 on hv-cinder-84914 Oct 04 05:46:17.134547 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-26cd7b30-9a2d-4e7a-8864-18fb459c0a0d req-c4c27d36-807c-49d0-aa0c-4c924795b10a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Oct 04 05:46:17.135140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 284/573] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:17.263395 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.273246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.274963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.276260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-38f7693a-50ed-420f-bae6-599292535e95 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.422887 Oct 04 05:46:17.276826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 290/574] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:16 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:17.347762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:17.348751 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:17.355322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.355903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.356455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.357220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.357747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.358752 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.500381 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.509375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2d9d60ee-c0f0-47e1-8e3c-9b0466ffe3bb tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1547 microversion: 2.1 time: 0.165919 Oct 04 05:46:17.510182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 285/575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:17 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:17.532066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:17.532677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:17.539213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.539751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.540367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.541070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.541519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.541944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.770696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.778701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-872e2528-d649-44e7-9c88-49b67875ddce tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1547 microversion: 2.1 time: 0.250356 Oct 04 05:46:17.779411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 291/576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:17 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:17.801940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:17.806850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:17.807617 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Searching by: {'deleted': False, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819'} {{(pid=127393) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 05:46:17.815927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.816645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.817082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.817871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.818371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.818798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.872856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:17.873553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:17.879579 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.880131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.880636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.881387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:17.881901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:17.882416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:17.919825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.multi_cell_list [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127393) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 05:46:18.016020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-79b64b71-4ce9-411f-a40c-1a5cf08fede5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218471 Oct 04 05:46:18.016771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 286/577] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 4 05:46:17 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:18.029838 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:18.030473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:18.037437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:18.037931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:18.038400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:18.039318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:18.039798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:18.040296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:18.103871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:18.111728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-542a060a-8055-422f-8bdc-18be9b374480 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.242802 Oct 04 05:46:18.112293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 292/578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:17 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:18.126435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:18.126760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:18.133438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:18.133935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:18.134370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:18.135069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:18.135594 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:18.135959 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:18.196476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:18.205402 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d1613efa-1923-4a64-ae9c-8cc6a6ee05df tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1547 microversion: 2.1 time: 0.179411 Oct 04 05:46:18.206635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 287/579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:18 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:18.245685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-628965524", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e58183d-6dc3-4dfa-97e6-588eb4bec1b8"}], "security_groups": [{"name": "tempest-securitygroup--1776230537"}], "key_name": "tempest-keypair-683898245", "user_data": "}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:18.277804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:18.286078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0fbedf41-ae0f-413d-b2fa-dac8fc8b3bc4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1680 microversion: 2.1 time: 0.164249 Oct 04 05:46:18.286904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 293/580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:18 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:18.307327 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:18.308142 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:18.314665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:18.315176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:18.315776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:18.316505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:18.316957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:18.317540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:18.367453 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] validate_networks() for [('4e58183d-6dc3-4dfa-97e6-588eb4bec1b8', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:46:18.469082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:18.479016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:18.480465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:18.482030 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ea7a730b-a60e-4d00-beb6-2c53c6f88936 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.182495 Oct 04 05:46:18.482636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 294/581] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:18 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:18.995467 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:46:18.995951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:46:18.996424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:46:18.996833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:46:18.997243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:46:19.006806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.007285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.007844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.008572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.009028 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.009450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.016841 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:19.027541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for project 689c4759cb5943b79f2637a8e29e230e. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:46:19.032472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Getting quotas for user c1b48a973c20470a9af23c77e3da5b72 and project 689c4759cb5943b79f2637a8e29e230e. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:46:19.042636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:46:19.044933 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:46:19.139572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:19.140333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:19.147282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.147772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.148205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.149091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.149562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.149975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.162471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-39830479-bf76-4756-abf0-c0bf7517a974 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.922845 Oct 04 05:46:19.163321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 288/582] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:46:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:46:19.173909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f0454c6f-9875-412b-81a3-fce41f1b36db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:19.174538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f0454c6f-9875-412b-81a3-fce41f1b36db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:19.227645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f0454c6f-9875-412b-81a3-fce41f1b36db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:19.236183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f0454c6f-9875-412b-81a3-fce41f1b36db tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1244 microversion: 2.1 time: 0.065925 Oct 04 05:46:19.236692 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 289/583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:19 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1244 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:19.312357 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:19.314080 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:19.314737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:19.320402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-853a08bd-cd70-4597-9848-7bcfa15b97f5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.185525 Oct 04 05:46:19.320800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.321137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 295/584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:19 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:19.321281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.321699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.322411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.322856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.323277 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.452916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:19.460602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-79fd0096-0cc9-4ab1-b46f-a01efcd54dd7 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1680 microversion: 2.1 time: 0.151173 Oct 04 05:46:19.461153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 290/585] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:19 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:19.508234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:19.508839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:19.514889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.515366 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.515799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.516581 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:19.517027 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:19.517450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:19.537056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:19.653215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:19.664181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:19.666801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:19.668071 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2fdff116-b4e6-4782-95c0-7ff7cc8fa6be tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1807 microversion: 2.20 time: 0.163735 Oct 04 05:46:19.673954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 296/586] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:19 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:20.177568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f086516d-1633-49c7-8a71-a4eb035e9e39"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:20.179983 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:20.186945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.187424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.187860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.188573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.188993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.189414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.263293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:20.263922 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:20.267881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:20.271643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.272130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.272574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.273271 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.273734 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.274160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.336972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:20.344727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-07c4e668-0186-46d2-a689-425132e10ddf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1248 microversion: 2.1 time: 0.085732 Oct 04 05:46:20.345289 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 297/587] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:20 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:20.349763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:20.350385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:20.356813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.357324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.357765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.358780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.358975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.359344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.492630 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:20.502275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9d97d9ae-cd02-4eaa-b429-5c1a6cfba344 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.155919 Oct 04 05:46:20.506958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 298/588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:20 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:20.511755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:20.512353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:20.519196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.519672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.520101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.520784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.521233 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.521647 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.656826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:20.673166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4f64f7c8-6406-49fe-a357-22fb70caab63 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1680 microversion: 2.1 time: 0.165000 Oct 04 05:46:20.673754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 299/589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:20 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:20.695431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:20.696927 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:20.704901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.705450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.712817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.712817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:20.712817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:20.712817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:20.841688 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:20.850887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:20.852336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:20.853506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-aa9ca38e-8832-459b-9808-eabe66c41479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1794 microversion: 2.20 time: 0.163274 Oct 04 05:46:20.854068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 300/590] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:46:20 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:46:21.168965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0d4b744a-145e-4f2f-84d6-7d5dac879421 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995157 Oct 04 05:46:21.174964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 291/591] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:46:20 2022] POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:21.367203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:21.367812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:21.374830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.375318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.375759 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.376452 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.376910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.377340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.470240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:21.472053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-ee3f294f-1755-415b-854b-ed73c50c00a7 req-e9cd2279-85cd-4f5e-a2ed-8331286684c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71aa646b-022b-46dc-a362-fe7d63d90f5a", "name": "network-vif-deleted", "tag": "91086c81-b058-42da-8552-c21268a1fe5f"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:21.479219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bbdbf02b-6e36-4cd1-907b-209c9137ce7e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1296 microversion: 2.1 time: 0.115726 Oct 04 05:46:21.479903 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 301/592] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:21 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:21.487507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-ee3f294f-1755-415b-854b-ed73c50c00a7 req-e9cd2279-85cd-4f5e-a2ed-8331286684c4 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.487996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-ee3f294f-1755-415b-854b-ed73c50c00a7 req-e9cd2279-85cd-4f5e-a2ed-8331286684c4 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.488488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-ee3f294f-1755-415b-854b-ed73c50c00a7 req-e9cd2279-85cd-4f5e-a2ed-8331286684c4 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.505939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-ee3f294f-1755-415b-854b-ed73c50c00a7 req-e9cd2279-85cd-4f5e-a2ed-8331286684c4 service nova] Creating event network-vif-deleted:91086c81-b058-42da-8552-c21268a1fe5f for instance 71aa646b-022b-46dc-a362-fe7d63d90f5a on hv-cinder-84914 Oct 04 05:46:21.511585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-ee3f294f-1755-415b-854b-ed73c50c00a7 req-e9cd2279-85cd-4f5e-a2ed-8331286684c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043304 Oct 04 05:46:21.516573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 292/593] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:21.527146 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:21.527807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:21.534226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.534663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.535100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.535807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.536288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.536711 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.690107 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:21.699512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f3821f0c-8a18-4fcd-ab71-35c61fcae8cc tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1319 microversion: 2.1 time: 0.177130 Oct 04 05:46:21.700387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 302/594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:21 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:21.701233 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:21.701938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:21.714822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.715326 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.715827 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.718079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:21.723385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:21.724008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:21.790716 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:21.798914 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ddbd147e-2be7-4d4f-9fc1-6c60d5652c4e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1326 microversion: 2.1 time: 0.103154 Oct 04 05:46:21.799512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 293/595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:21 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:22.354498 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-694547d1-d39c-468d-9cb6-3e7953601b2e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:22.360937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-694547d1-d39c-468d-9cb6-3e7953601b2e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.361447 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-694547d1-d39c-468d-9cb6-3e7953601b2e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.361978 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-694547d1-d39c-468d-9cb6-3e7953601b2e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.386596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-694547d1-d39c-468d-9cb6-3e7953601b2e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Going to try to stop instance {{(pid=127392) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 05:46:22.508118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:22.508118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:22.512489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.513105 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.513612 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.514511 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.515001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.515461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.605765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:22.608833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-694547d1-d39c-468d-9cb6-3e7953601b2e tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action" status: 202 len: 0 microversion: 2.1 time: 0.257070 Oct 04 05:46:22.613774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 303/596] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:46:22 2022] POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:22.621969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-06984288-9eb8-47d8-928a-a36feaa1f269 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1296 microversion: 2.1 time: 0.113715 Oct 04 05:46:22.622839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 294/597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:22 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:22.628603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:22.629165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:22.647500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.647995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.648476 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.649184 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.649638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.650183 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.728280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:22.728908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:22.735419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.735925 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.736350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.737046 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.737561 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.737981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.800940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:22.809949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8121e6a9-8e98-442f-87d9-9538e40c10b8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.193191 Oct 04 05:46:22.809949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 304/598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:22 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:22.823519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:22.824123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:22.830945 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.831427 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.831968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.832542 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.835639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.835951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.884544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:22.884737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.885531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.886012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.886495 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid 71aa646b-022b-46dc-a362-fe7d63d90f5a {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:22.893639 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e31d08fd-e67e-4527-9f6b-4f69f09a3705 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1507 microversion: 2.1 time: 0.169794 Oct 04 05:46:22.902747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 295/599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:22 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:22.916958 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ed18603-3c59-4f62-95f9-a379df49d4da", "device": "/dev/sdb"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:22.919789 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:22.925677 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.926189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.926705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.927404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:22.927854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:22.928272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:22.930415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:22.943446 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8ccbfc9e-77af-4bdf-9e51-ca447e033175 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1331 microversion: 2.1 time: 0.123871 Oct 04 05:46:22.953017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 305/600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:22 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:23.650375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:23.650983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:23.657570 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:23.658055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:23.658649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:23.659486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:23.659943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:23.660456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:23.729802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:23.738547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-47eaf993-ba5c-49da-b37e-28d41704e67e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1304 microversion: 2.1 time: 0.091998 Oct 04 05:46:23.739970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 306/601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:23 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:23.832700 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:23.833725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:23.839984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:23.840477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:23.841090 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:23.841799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:23.842328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:23.842760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:23.978242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:23.986241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c3bda7e5-30a4-4ba0-aa34-b0980f9d5bd7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.157359 Oct 04 05:46:23.986808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 307/602] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:23 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:24.005248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:24.005847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:24.011582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:24.012059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:24.012491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:24.013171 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:24.013620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:24.014070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:24.044487 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:24.044956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:24.045388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:24.045823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid 71aa646b-022b-46dc-a362-fe7d63d90f5a {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:24.085051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:24.092860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-436aa0d2-3b62-4323-8b01-4ee91e813056 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 200 len: 1331 microversion: 2.1 time: 0.091755 Oct 04 05:46:24.093419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 308/603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:23 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:24.189837 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f0b39ba3-9fa8-4295-a6e5-7d51eac268e5 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "POST /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.276719 Oct 04 05:46:24.190701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 296/604] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:46:22 2022] POST /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533/os-volume_attachments => generated 194 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:24.763668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:24.764482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:24.771290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:24.771771 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:24.772200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:24.772890 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:24.773362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:24.773942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:24.914504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:24.922483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b22d556e-e1d0-4899-9632-2367f4d81681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.163201 Oct 04 05:46:24.923419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 309/605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:24 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:25.009848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:25.010584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:25.017451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:25.017923 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:25.018393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:25.019073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:25.019516 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:25.019931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:25.116124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:25.116839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:25.122784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:25.123341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:25.123867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:25.124626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:25.125154 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:25.125647 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:25.139075 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a HTTP/1.1 Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:46:25.140706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:46:25.142344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '71aa646b-022b-46dc-a362-fe7d63d90f5a'} Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:46:25.143286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:46:25.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:46:25.145912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:46:25.145912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-aa97b0b0-6257-4355-8669-64b149c7a42a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 404 len: 111 microversion: 2.1 time: 0.030383 Oct 04 05:46:25.146449 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 310/606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:25 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:46:25.159568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d0be5776-1a6c-4ae4-a425-416f3aee1009 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '.version_select at 0x7f0486555280>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:25.244127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:25.251934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0a7427a8-39e5-49ac-8d78-8d8d0e74ebee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.246233 Oct 04 05:46:25.252720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 297/607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:25 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:25.274333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d0be5776-1a6c-4ae4-a425-416f3aee1009 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822461495" status: 202 len: 0 microversion: 2.1 time: 0.118590 Oct 04 05:46:25.274906 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 311/608] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 05:46:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822461495 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:46:25.946735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:25.947399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:25.953530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:25.954217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:25.954659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:25.955348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:25.955803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:25.956223 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:26.162276 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:26.169835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ba57bfb1-6db1-4b8d-9b78-4852181248e5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.227831 Oct 04 05:46:26.170432 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 298/609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:25 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:26.275457 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:26.276052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:26.277965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=4 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:26.284025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:26.284504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:26.284949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:26.285616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:26.286060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:26.286504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:26.351690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-f11bdd00-a4f9-4c0e-9515-08861b760b59 req-51b1a878-f868-4592-b125-3cd10d4acd3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef1eaae-b386-4ce1-9d08-63972bda8851", "tag": "6aff3573-db21-4dc2-80d8-968b7594ff8b"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:26.365036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-f11bdd00-a4f9-4c0e-9515-08861b760b59 req-51b1a878-f868-4592-b125-3cd10d4acd3c service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:26.365709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-f11bdd00-a4f9-4c0e-9515-08861b760b59 req-51b1a878-f868-4592-b125-3cd10d4acd3c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:26.366464 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-f11bdd00-a4f9-4c0e-9515-08861b760b59 req-51b1a878-f868-4592-b125-3cd10d4acd3c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:26.381138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-f11bdd00-a4f9-4c0e-9515-08861b760b59 req-51b1a878-f868-4592-b125-3cd10d4acd3c service nova] Creating event network-changed:6aff3573-db21-4dc2-80d8-968b7594ff8b for instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 on hv-cinder-84914 Oct 04 05:46:26.386510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-f11bdd00-a4f9-4c0e-9515-08861b760b59 req-51b1a878-f868-4592-b125-3cd10d4acd3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052917 Oct 04 05:46:26.387138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 299/610] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:26.392784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cfc7042a-a6a8-4d5a-97d1-c33fd2c625f5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: .version_select at 0x7f04863e2940>, body: {"keypair": {"name": "tempest-keypair-812599921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPjAy2qPMh6ftODYPNnCiiEsLvx2AuySbdHAJ0zI7xc5IiTvxkD9o3MiMEjd/aDqx0kcP4djZiWKnvAdYC/pHiuUdPFjbJHtGzkltgM5iUIvZKa/fhe348bgA8Gvd43tA=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:26.409572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-cfc7042a-a6a8-4d5a-97d1-c33fd2c625f5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:46:26.414553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-cfc7042a-a6a8-4d5a-97d1-c33fd2c625f5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:46:26.452000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:26.460232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cde55a7c-5ef3-497d-bdd2-b4c485444332 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.188587 Oct 04 05:46:26.460812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 312/611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:26 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:26.544278 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cfc7042a-a6a8-4d5a-97d1-c33fd2c625f5 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155638 Oct 04 05:46:26.545089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 300/612] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:46:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:27.193312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:27.194013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:27.200259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:27.200828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:27.201364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:27.202072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:27.202590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:27.203018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:27.207058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:27.339938 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:27.347483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-73f6545f-d5e1-4ee7-8131-ff0c92a66a6a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.158092 Oct 04 05:46:27.348048 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 313/613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:27 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:27.483728 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:27.484445 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:27.490613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:27.491087 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:27.491517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:27.492195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:27.492636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:27.493057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:27.627713 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:27.636196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c043bc92-0445-4b66-8df3-3b53f10b7606 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.156802 Oct 04 05:46:27.636770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 301/614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:27 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:28.374766 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:28.375476 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:28.382281 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:28.382765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:28.383204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:28.383894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:28.384345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:28.384768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:28.587902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:28.595787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-dbabef1c-b89f-4445-89a3-a06d83f9d308 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.225258 Oct 04 05:46:28.596351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 314/615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:28 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:28.659633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:28.660332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:28.667443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:28.667920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:28.668357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:28.669044 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:28.669493 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:28.669916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:28.805929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:28.814308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7a984600-5b0a-4ab2-853f-f74bcecfdc10 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.158366 Oct 04 05:46:28.814950 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 302/616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:28 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:28.933997 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1746965306", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c58c152-65b4-475d-9100-474584bb25cf"}], "security_groups": [{"name": "tempest-securitygroup--30049575"}], "key_name": "tempest-keypair-812599921", "user_data": "}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:29.038409 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] validate_networks() for [('2c58c152-65b4-475d-9100-474584bb25cf', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:46:29.402073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:46:29.402637 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:46:29.402970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:46:29.403373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:46:29.403772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:46:29.412519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:29.413015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:29.413441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:29.414174 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:29.414624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:29.415048 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:29.431710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:46:29.435695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:46:29.447262 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:46:29.449523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:46:29.580410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7a75f3c2-fd81-4d83-8b06-6f9bb605e839 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.650680 Oct 04 05:46:29.581314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 315/617] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:46:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:46:29.593164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-da672e71-c74f-44e5-a567-5316f32d3877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:29.593855 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-da672e71-c74f-44e5-a567-5316f32d3877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:29.596937 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:29.597672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:29.620855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:29.621553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:29.629503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:29.630385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:29.631018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:29.639931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:29.639931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:29.639931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:29.653909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-da672e71-c74f-44e5-a567-5316f32d3877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:29.661523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-da672e71-c74f-44e5-a567-5316f32d3877 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1241 microversion: 2.1 time: 0.071659 Oct 04 05:46:29.662552 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 303/618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:29 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:29.784866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:29.793617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2fa45178-f67b-426c-9a9a-8876a39c4159 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.176988 Oct 04 05:46:29.794198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 316/619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:29 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:29.838027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:29.838672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:29.846183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:29.846861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:29.847482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:29.848181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:29.849320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:29.849755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:29.987627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:29.996086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7d1937a9-331a-453d-8aab-01193c98ce05 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.161905 Oct 04 05:46:29.996868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 304/620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:29 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:30.684779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-94b30c9e-6512-40f5-bc63-ee6159bd543d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:30.685383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-94b30c9e-6512-40f5-bc63-ee6159bd543d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:30.741912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-94b30c9e-6512-40f5-bc63-ee6159bd543d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:30.750180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-94b30c9e-6512-40f5-bc63-ee6159bd543d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1241 microversion: 2.1 time: 0.068076 Oct 04 05:46:30.750180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 317/621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:30 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:30.817907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:30.818634 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:30.824982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:30.825459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:30.825950 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:30.826690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:30.827115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:30.827537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:30.946395 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:30.947102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:30.954064 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:30.958096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:30.958096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:30.958096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:30.958096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:30.958565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:30.971127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:30.980627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-176f1dd7-691f-4518-b10c-ebbf20f8e9f2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.167048 Oct 04 05:46:30.982931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 305/622] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:30 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:31.022364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:31.023096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:31.032899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:31.032899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:31.032899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:31.032899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:31.033350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:31.033350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:31.092550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:31.102032 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-542faa1a-0904-4c1e-8baa-9c3ff7c6921d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1593 microversion: 2.1 time: 0.160917 Oct 04 05:46:31.115833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 318/623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:30 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:31.115833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-abcd19de-5506-4b0a-b5f2-eaa1d809340d req-41a945ee-709c-4fef-9116-23ea8d0616fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef1eaae-b386-4ce1-9d08-63972bda8851", "name": "network-vif-plugged", "status": "completed", "tag": "6aff3573-db21-4dc2-80d8-968b7594ff8b"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:31.119701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-abcd19de-5506-4b0a-b5f2-eaa1d809340d req-41a945ee-709c-4fef-9116-23ea8d0616fa service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:31.120483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-abcd19de-5506-4b0a-b5f2-eaa1d809340d req-41a945ee-709c-4fef-9116-23ea8d0616fa service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:31.121159 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-abcd19de-5506-4b0a-b5f2-eaa1d809340d req-41a945ee-709c-4fef-9116-23ea8d0616fa service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:31.138028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-abcd19de-5506-4b0a-b5f2-eaa1d809340d req-41a945ee-709c-4fef-9116-23ea8d0616fa service nova] Creating event network-vif-plugged:6aff3573-db21-4dc2-80d8-968b7594ff8b for instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 on hv-cinder-84914 Oct 04 05:46:31.143886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-abcd19de-5506-4b0a-b5f2-eaa1d809340d req-41a945ee-709c-4fef-9116-23ea8d0616fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039491 Oct 04 05:46:31.144744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 319/624] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:31.207866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:31.215693 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3c144ff0-6d45-4805-872e-09a1498ec502 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.197967 Oct 04 05:46:31.216342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 306/625] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:31 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:31.774506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:31.775207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:31.782356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:31.782873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:31.783311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:31.784008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:31.784459 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:31.784883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:31.853464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:31.861508 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-454762c0-2aaf-485c-acfa-345688e25ca0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1293 microversion: 2.1 time: 0.092825 Oct 04 05:46:31.862080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 320/626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:31 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:32.004179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:32.006457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:32.012953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:32.013597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:32.013972 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:32.014766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:32.015217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:32.015766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:32.019802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:32.240392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:32.241007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:32.246533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:32.247403 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:32.247892 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:32.248359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:32.249257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:32.249904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:32.250512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:32.255957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3d1c6326-f08f-4eac-b1a1-22e29717de8c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.255963 Oct 04 05:46:32.256664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 307/627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:31 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:32.384493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:32.392186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9b95fa9d-0347-4e78-a84f-90bd536d9d23 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.157123 Oct 04 05:46:32.393337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 321/628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:32 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:32.885620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:32.886279 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:32.892839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:32.893261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:32.893695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:32.894424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:32.894873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:32.895406 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:32.966510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:32.974863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-11874912-b6f7-40a9-9afe-86bbb97b1daf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1293 microversion: 2.1 time: 0.094073 Oct 04 05:46:32.975431 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 308/629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:32 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:33.209213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-107e6eda-6cfa-45bc-9701-def3ce1e2d87 req-3604629b-1041-4b0e-b2f4-e65e8d669fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:33.218184 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-107e6eda-6cfa-45bc-9701-def3ce1e2d87 req-3604629b-1041-4b0e-b2f4-e65e8d669fb3 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:33.218638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-107e6eda-6cfa-45bc-9701-def3ce1e2d87 req-3604629b-1041-4b0e-b2f4-e65e8d669fb3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:33.219170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-107e6eda-6cfa-45bc-9701-def3ce1e2d87 req-3604629b-1041-4b0e-b2f4-e65e8d669fb3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:33.231032 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-107e6eda-6cfa-45bc-9701-def3ce1e2d87 req-3604629b-1041-4b0e-b2f4-e65e8d669fb3 service nova] Creating event network-changed:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:46:33.235829 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-107e6eda-6cfa-45bc-9701-def3ce1e2d87 req-3604629b-1041-4b0e-b2f4-e65e8d669fb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031704 Oct 04 05:46:33.236413 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 322/630] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:33.278605 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:33.279317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:33.285807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:33.286998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:33.287503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:33.288270 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:33.288786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:33.289240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:33.424004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:33.424004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:33.425077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:33.425758 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:33.426707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:33.427598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:33.428210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:33.428962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:33.439456 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:33.450058 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-325d0404-cbdf-4725-b0df-08203efeb179 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1370 microversion: 2.1 time: 0.175279 Oct 04 05:46:33.464092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 309/631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:33 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:33.608142 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:33.616257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8dd07fb4-01a2-44c5-bac8-4c7e792580cb tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1676 microversion: 2.1 time: 0.203540 Oct 04 05:46:33.617372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 323/632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:33 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:33.996908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:33.997769 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:34.004418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.005535 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.006042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.006845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.007377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.008452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.125160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:34.133639 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a06a2a21-259b-4584-9054-125b01502f3d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1301 microversion: 2.1 time: 0.140498 Oct 04 05:46:34.134857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 310/633] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:33 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1301 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:34.477440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:34.479112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:34.491038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.491521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.491956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.492661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.493105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.506949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.639823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:34.641076 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:34.650281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.651039 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.651632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.652516 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.653113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.654175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.680534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:34.688595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4f47b127-1d0d-4379-a2d5-b90dda1b49b3 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1564 microversion: 2.1 time: 0.218508 Oct 04 05:46:34.689259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 324/634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:34 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1564 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:34.713064 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:34.713773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:34.720189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.720884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.721486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.722678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.723234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.724316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.811862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ae7cdb7f-91a1-4684-b92b-fa908b991d45 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102685 Oct 04 05:46:34.811862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 325/635] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:46:34 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:34.858126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:34.866688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-20181c29-9077-44d6-98cf-3c1197a686b4 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1653 microversion: 2.1 time: 0.231032 Oct 04 05:46:34.867264 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 311/636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:34 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1653 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:34.917812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cf6ab140-1a4e-4641-8035-42d2c6c9cf75 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:34.924209 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf6ab140-1a4e-4641-8035-42d2c6c9cf75 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:34.924687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf6ab140-1a4e-4641-8035-42d2c6c9cf75 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:34.925120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cf6ab140-1a4e-4641-8035-42d2c6c9cf75 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:34.948642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-cf6ab140-1a4e-4641-8035-42d2c6c9cf75 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Going to try to start instance {{(pid=127392) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 05:46:35.157715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:35.158689 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:35.165412 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:35.166096 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:35.166942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:35.167809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:35.168382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:35.168928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:35.192957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cf6ab140-1a4e-4641-8035-42d2c6c9cf75 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action" status: 202 len: 0 microversion: 2.1 time: 0.281600 Oct 04 05:46:35.194371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 326/637] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:46:34 2022] POST /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:35.217614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:35.218852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:35.226542 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:35.227053 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:35.227488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:35.228248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:35.228709 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:35.229141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:35.392174 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:35.403362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-02028744-9bff-4ee4-b5ae-3f9c37b3ad99 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1299 microversion: 2.1 time: 0.249889 Oct 04 05:46:35.414809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 312/638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:35 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:35.532628 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:35.542624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ba9e6032-d505-4256-b399-8033ce8618ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1662 microversion: 2.1 time: 0.332691 Oct 04 05:46:35.543415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 327/639] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:35 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1662 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:36.169203 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-409b08e2-fd0c-43df-859c-e3117fbaa1f6 req-8f666e56-1e45-4650-93f1-fec483f48384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef1eaae-b386-4ce1-9d08-63972bda8851", "tag": "6aff3573-db21-4dc2-80d8-968b7594ff8b"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:36.187800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-409b08e2-fd0c-43df-859c-e3117fbaa1f6 req-8f666e56-1e45-4650-93f1-fec483f48384 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:36.188366 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-409b08e2-fd0c-43df-859c-e3117fbaa1f6 req-8f666e56-1e45-4650-93f1-fec483f48384 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:36.188864 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-409b08e2-fd0c-43df-859c-e3117fbaa1f6 req-8f666e56-1e45-4650-93f1-fec483f48384 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:36.202651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-409b08e2-fd0c-43df-859c-e3117fbaa1f6 req-8f666e56-1e45-4650-93f1-fec483f48384 service nova] Creating event network-changed:6aff3573-db21-4dc2-80d8-968b7594ff8b for instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 on hv-cinder-84914 Oct 04 05:46:36.208748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-409b08e2-fd0c-43df-859c-e3117fbaa1f6 req-8f666e56-1e45-4650-93f1-fec483f48384 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042421 Oct 04 05:46:36.209679 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 313/640] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:36.430648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:36.431253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:36.439037 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:36.444226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:36.444696 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:36.445422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:36.445941 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:36.446644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:36.569733 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:36.570708 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:36.579050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:36.580063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:36.580511 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:36.581435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:36.581869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:36.582332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:36.596039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:36.604628 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e545edb8-fecd-490b-b45d-b1bc5ae00148 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.177864 Oct 04 05:46:36.605964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 328/641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:36 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:36.916254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:36.925273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6acc3828-93da-4544-96f7-14a7c28efc50 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1662 microversion: 2.1 time: 0.361902 Oct 04 05:46:36.925857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 314/642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:36 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1662 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:37.013704 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1689999304"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:37.014947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:37.022725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.023723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.024233 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.025526 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.026055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.026608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.188091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.network.security_group_api [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Adding security group e2beedac-f946-4c31-af85-7e6c924292ed to port 488f01ec-9da2-43ab-bec8-f65c29213231 Oct 04 05:46:37.601209 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5fcaf4d6-49f2-4b17-b951-74d130218f7c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/action" status: 202 len: 0 microversion: 2.1 time: 0.591779 Oct 04 05:46:37.604275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 329/643] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:46:37 2022] POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:37.615434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:37.616044 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:37.624437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.625191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.625785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.626730 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.627346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.628014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.631795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:37.632810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:37.644152 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.644935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.646411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.647959 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.648593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.649196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.805985 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:37.831011 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a095eaf2-ba47-4a12-adaf-a1c564baa6f0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1758 microversion: 2.1 time: 0.208815 Oct 04 05:46:37.831011 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 315/644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:37 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:37.837621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:37.849096 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-03a6301a-ac25-4a38-b1de-7fa660ae29aa tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.222310 Oct 04 05:46:37.854285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 330/645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:37 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:37.888429 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-61193ad8-290d-48d6-b4e6-e2e07926c5a9 req-c300c62d-9142-42c6-a1db-e432bed43330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc3ace6-a575-4b82-8b82-a578d13bb43c", "tag": "85eef61c-7813-4495-a4cb-e1f1f1d9d6f1"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:37.904492 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-61193ad8-290d-48d6-b4e6-e2e07926c5a9 req-c300c62d-9142-42c6-a1db-e432bed43330 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.904973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-61193ad8-290d-48d6-b4e6-e2e07926c5a9 req-c300c62d-9142-42c6-a1db-e432bed43330 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.905461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-61193ad8-290d-48d6-b4e6-e2e07926c5a9 req-c300c62d-9142-42c6-a1db-e432bed43330 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.916955 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-61193ad8-290d-48d6-b4e6-e2e07926c5a9 req-c300c62d-9142-42c6-a1db-e432bed43330 service nova] Creating event network-changed:85eef61c-7813-4495-a4cb-e1f1f1d9d6f1 for instance edc3ace6-a575-4b82-8b82-a578d13bb43c on hv-cinder-84914 Oct 04 05:46:37.922359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-61193ad8-290d-48d6-b4e6-e2e07926c5a9 req-c300c62d-9142-42c6-a1db-e432bed43330 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038580 Oct 04 05:46:37.923616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 316/646] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:37.951287 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:37.952436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:37.960299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.964704 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.966166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:37.968323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:37.969149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:37.969862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:38.119572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:38.130825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6d883001-d584-4787-bc0b-44d8f7ddd6ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1662 microversion: 2.1 time: 0.183214 Oct 04 05:46:38.131493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 331/647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:37 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1662 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:38.223484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-01098b08-64d6-4ca9-9019-c7ddd0ba5234 req-7e493e5c-7e98-4456-84a4-1d1b22ab6979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:38.233115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-01098b08-64d6-4ca9-9019-c7ddd0ba5234 req-7e493e5c-7e98-4456-84a4-1d1b22ab6979 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:38.233586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-01098b08-64d6-4ca9-9019-c7ddd0ba5234 req-7e493e5c-7e98-4456-84a4-1d1b22ab6979 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:38.234013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-01098b08-64d6-4ca9-9019-c7ddd0ba5234 req-7e493e5c-7e98-4456-84a4-1d1b22ab6979 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:38.245284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-01098b08-64d6-4ca9-9019-c7ddd0ba5234 req-7e493e5c-7e98-4456-84a4-1d1b22ab6979 service nova] Creating event network-changed:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:46:38.250206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-01098b08-64d6-4ca9-9019-c7ddd0ba5234 req-7e493e5c-7e98-4456-84a4-1d1b22ab6979 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030949 Oct 04 05:46:38.250800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 317/648] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:38.874865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:38.875462 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:38.882585 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:38.883070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:38.883772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:38.884401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:38.884856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:38.885276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:38.910261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:39.037778 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:39.046378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-88d79bc6-c606-47ed-a30f-1620b9ab3221 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.175344 Oct 04 05:46:39.046950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 332/649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:38 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:39.159720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:39.161272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:39.171315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:39.171315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:39.171315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:39.171315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:39.171610 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:39.171947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:39.464417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:39.472256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7bb57842-418c-4ddf-8924-fa5eeb3820c5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1666 microversion: 2.1 time: 0.316658 Oct 04 05:46:39.472833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 318/650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:39 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1666 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:40.070949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:40.071481 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:40.073251 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:40.078966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:40.079443 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:40.079879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:40.080559 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:40.081010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:40.081432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:40.208752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:40.216957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-83ab617b-5c61-444a-8913-47a8d50ead2a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.150845 Oct 04 05:46:40.217514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 333/651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:40 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:41.239664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:41.240258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:41.242232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=14 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:41.247535 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:41.248007 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:41.248441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:41.249125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:41.249577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:41.250000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:41.380522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:41.388126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d847bf91-ec7d-488e-bd76-b5b2ff3b78bf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.152337 Oct 04 05:46:41.388691 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 319/652] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:41 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:42.410776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:42.411388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:42.413711 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=8 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:42.419100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:42.419578 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:42.420012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:42.420695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:42.421145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:42.421564 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:42.548683 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:42.556795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2df674b9-c6ad-426c-97a5-0ba0371df2fc tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.149874 Oct 04 05:46:42.557365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 334/653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:42 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:43.579697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:43.580234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:43.586718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:43.587200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:43.587635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:43.588317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:43.588765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:43.589189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:43.712943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:43.720649 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8eaa9cad-146a-4c83-8a43-128f82d3525e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.144928 Oct 04 05:46:43.721211 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 320/654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:43 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:44.743335 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:44.743874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:44.747295 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:44.750622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:44.751098 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:44.751527 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:44.753853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:44.753853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:44.753853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:44.878196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:44.886309 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c23dcbaa-470f-41c9-9bce-1e105096ddd4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.146861 Oct 04 05:46:44.886879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 335/655] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:44 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:45.909225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:45.909822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:45.917207 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:45.917677 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:45.918107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:45.918810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:45.919250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:45.919666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:46.043641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:46.051213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-79e78767-e804-424b-ac2b-4b9a6b9cfa1c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.145890 Oct 04 05:46:46.051777 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 321/656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:45 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:47.074034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:47.074671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:47.081073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:47.081545 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:47.081973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:47.082680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:47.083129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:47.083549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:47.208605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:47.222195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6ea6fd2e-e114-480e-b400-0ee4feddd69e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.151880 Oct 04 05:46:47.222806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 336/657] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:47 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:48.244799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:48.245615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:48.252257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:48.252766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:48.253444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:48.254494 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:48.254821 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:48.255274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:48.388344 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:48.396060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-00fb3a0a-4856-4fa1-aa88-bdffd3582eeb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.155179 Oct 04 05:46:48.396617 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 322/658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:48 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:49.418956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:49.419572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:49.431442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:49.436780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:49.437326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:49.438204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:49.438784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:49.439294 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:49.544615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-fa2c81f5-8255-47ad-b4b1-7a43ace43e03 req-4fa45d98-b936-44e8-be3c-912d2852d693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc3ace6-a575-4b82-8b82-a578d13bb43c", "name": "network-vif-plugged", "status": "completed", "tag": "85eef61c-7813-4495-a4cb-e1f1f1d9d6f1"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:49.556903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fa2c81f5-8255-47ad-b4b1-7a43ace43e03 req-4fa45d98-b936-44e8-be3c-912d2852d693 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:49.557439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fa2c81f5-8255-47ad-b4b1-7a43ace43e03 req-4fa45d98-b936-44e8-be3c-912d2852d693 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:49.557926 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fa2c81f5-8255-47ad-b4b1-7a43ace43e03 req-4fa45d98-b936-44e8-be3c-912d2852d693 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:49.576297 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-fa2c81f5-8255-47ad-b4b1-7a43ace43e03 req-4fa45d98-b936-44e8-be3c-912d2852d693 service nova] Creating event network-vif-plugged:85eef61c-7813-4495-a4cb-e1f1f1d9d6f1 for instance edc3ace6-a575-4b82-8b82-a578d13bb43c on hv-cinder-84914 Oct 04 05:46:49.576790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:49.581630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-fa2c81f5-8255-47ad-b4b1-7a43ace43e03 req-4fa45d98-b936-44e8-be3c-912d2852d693 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045960 Oct 04 05:46:49.584885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 323/659] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:49.585381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0d6d3e0e-a267-43ec-a10d-ee7a22580c1d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.170042 Oct 04 05:46:49.585814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 337/660] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:49 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:50.608487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:50.609164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:50.615283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:50.615755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:50.616517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:50.617720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:50.618595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:50.619354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:50.751522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:50.759671 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b676bf58-bff2-421a-8fd0-24216d44cc58 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1365 microversion: 2.1 time: 0.155847 Oct 04 05:46:50.760240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 324/661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:50 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:51.758558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:51.759082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:51.765562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:51.766044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:51.766519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:51.767204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:51.767654 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:51.768077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:51.782982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:51.783833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:51.790277 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:51.790762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:51.791392 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:51.792080 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:51.792522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:51.792940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:51.849911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lazy-loading 'services' on Instance uuid 3fda981d-f498-4476-be14-b2b88a990533 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:51.929417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:51.938101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fa21c92f-9bc1-42d5-a4f0-bfaa5b63c555 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1556 microversion: 2.1 time: 0.158914 Oct 04 05:46:51.938721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 325/662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:51 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:46:51.960467 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:51.960954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:51.966901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:51.967384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:51.967822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:51.968731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:51.969190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:51.969617 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:51.986289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:46:52.045675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c1503087-af05-471b-b51e-14c19b9e8ed7 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533/os-volume_attachments/9ed18603-3c59-4f62-95f9-a379df49d4da" status: 202 len: 0 microversion: 2.1 time: 0.291728 Oct 04 05:46:52.046294 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 338/663] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:46:51 2022] DELETE /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533/os-volume_attachments/9ed18603-3c59-4f62-95f9-a379df49d4da => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:46:52.052602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9bccc8de-d641-40be-8ee7-5321bae14583 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095968 Oct 04 05:46:52.053213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 326/664] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:46:51 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:46:53.024185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-879a5202-45ac-49af-a5c4-b73d21af6cc0 req-07a7fdd9-141c-4636-bf8d-719d571fc325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc3ace6-a575-4b82-8b82-a578d13bb43c", "tag": "85eef61c-7813-4495-a4cb-e1f1f1d9d6f1"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:53.033738 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-879a5202-45ac-49af-a5c4-b73d21af6cc0 req-07a7fdd9-141c-4636-bf8d-719d571fc325 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:53.034236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-879a5202-45ac-49af-a5c4-b73d21af6cc0 req-07a7fdd9-141c-4636-bf8d-719d571fc325 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:53.034693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-879a5202-45ac-49af-a5c4-b73d21af6cc0 req-07a7fdd9-141c-4636-bf8d-719d571fc325 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:53.045966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-879a5202-45ac-49af-a5c4-b73d21af6cc0 req-07a7fdd9-141c-4636-bf8d-719d571fc325 service nova] Creating event network-changed:85eef61c-7813-4495-a4cb-e1f1f1d9d6f1 for instance edc3ace6-a575-4b82-8b82-a578d13bb43c on hv-cinder-84914 Oct 04 05:46:53.050775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-879a5202-45ac-49af-a5c4-b73d21af6cc0 req-07a7fdd9-141c-4636-bf8d-719d571fc325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031212 Oct 04 05:46:53.051454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 339/665] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:54.228459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:54.228967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:54.235345 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:54.235826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:54.236613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:54.236964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:54.237416 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:54.237845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:54.264365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:46:54.553800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e82fdcab-f486-45f3-aea6-292ced9f814b tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 204 len: 0 microversion: 2.1 time: 0.328819 Oct 04 05:46:54.554476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 327/666] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:46:54 2022] DELETE /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:46:54.563845 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:54.564566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:54.570834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:54.571308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:54.571735 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:54.572411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:54.572854 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:54.573282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:54.704472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:54.712573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-206bfd1e-d3d9-4627-9392-3e2c83238e58 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1513 microversion: 2.1 time: 0.153685 Oct 04 05:46:54.713130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 340/667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:54 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:55.736972 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:55.737598 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:55.744119 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:55.744594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:55.745020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:55.745696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:55.746170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:55.746596 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:55.875918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:55.884026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-898b211b-fe09-4fc7-9ae6-581b6556096f tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1513 microversion: 2.1 time: 0.151525 Oct 04 05:46:55.884593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 328/668] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:55 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:56.907546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:56.908182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:56.915739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:56.916231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:56.916671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:56.917422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:56.917879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:56.918342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:57.044041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:57.052059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1303e284-1f37-4e2c-a034-7376b5cff7d2 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1513 microversion: 2.1 time: 0.148460 Oct 04 05:46:57.052617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 341/669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:56 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:57.457553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-488e71ca-bca6-4731-9c18-d25bac7c9ea1 req-a4d7cd6b-f9f0-475e-a82f-55d3f9e95058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fda981d-f498-4476-be14-b2b88a990533", "name": "network-vif-deleted", "tag": "2e2c203f-0112-4068-8b70-eca7f47e4da8"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:46:57.467945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-488e71ca-bca6-4731-9c18-d25bac7c9ea1 req-a4d7cd6b-f9f0-475e-a82f-55d3f9e95058 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:57.468462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-488e71ca-bca6-4731-9c18-d25bac7c9ea1 req-a4d7cd6b-f9f0-475e-a82f-55d3f9e95058 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:57.468872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-488e71ca-bca6-4731-9c18-d25bac7c9ea1 req-a4d7cd6b-f9f0-475e-a82f-55d3f9e95058 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:57.479954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-488e71ca-bca6-4731-9c18-d25bac7c9ea1 req-a4d7cd6b-f9f0-475e-a82f-55d3f9e95058 service nova] Creating event network-vif-deleted:2e2c203f-0112-4068-8b70-eca7f47e4da8 for instance 3fda981d-f498-4476-be14-b2b88a990533 on hv-cinder-84914 Oct 04 05:46:57.484859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-488e71ca-bca6-4731-9c18-d25bac7c9ea1 req-a4d7cd6b-f9f0-475e-a82f-55d3f9e95058 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Oct 04 05:46:57.485434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 329/670] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:46:58.075519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:58.076372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:58.082854 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:58.083329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:58.083785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:58.085179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:58.085633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:58.086307 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:58.116269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:58.116737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:58.117167 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:58.117606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lazy-loading 'fault' on Instance uuid 3fda981d-f498-4476-be14-b2b88a990533 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:46:58.157816 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877575c9e0264241b9eab868a89cbbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e003d2bea5f04ac7a70fd2b7d2ee1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:46:58.165501 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-205e07ac-7fea-4f53-90a6-ec4a37800736 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 200 len: 1309 microversion: 2.1 time: 0.093895 Oct 04 05:46:58.166056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 342/671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:58 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:46:59.188393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:46:59.188990 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] [instance: 3fda981d-f498-4476-be14-b2b88a990533] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:46:59.196184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:59.196654 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:59.197083 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:59.197756 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:46:59.198226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:46:59.198645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:46:59.211309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] HTTP exception thrown: Instance 3fda981d-f498-4476-be14-b2b88a990533 could not be found. Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Request method failure captured: Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 HTTP/1.1 Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8gWxKi4A8atfPk3zn-MqhP5d_Qwgwv65IIM6QBIzLuY-FXBtdH41uLkaJ4hLb2PIMyD7thxrp6umy-PcGkS09x8JXpE9_vqNpVNl2v6dwSZtHWCzNqZdZmv05FBySLbN8Yu79Dmr_1jxl8Qj_o6GIstyrcASQWzjyehy2SXyWcgIlE Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: e003d2bea5f04ac7a70fd2b7d2ee1f91 Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesSnapshotTestJSON-849826855 Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:46:59.212907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e003d2bea5f04ac7a70fd2b7d2ee1f91", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e003d2bea5f04ac7a70fd2b7d2ee1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e003d2bea5f04ac7a70fd2b7d2ee1f91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e003d2bea5f04ac7a70fd2b7d2ee1f91"}]}] Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesSnapshotTestJSON-849826855 Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: e003d2bea5f04ac7a70fd2b7d2ee1f91 Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-849826855 Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesSnapshotTestJSON-849826855-project Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 877575c9e0264241b9eab868a89cbbe8 Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesSnapshotTestJSON-849826855-project Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 3fda981d-f498-4476-be14-b2b88a990533 could not be found. Oct 04 05:46:59.214498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '3fda981d-f498-4476-be14-b2b88a990533'} Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fda981d-f498-4476-be14-b2b88a990533 could not be found. Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:46:59.215365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fda981d-f498-4476-be14-b2b88a990533 could not be found. Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fda981d-f498-4476-be14-b2b88a990533 could not be found. Oct 04 05:46:59.216915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:46:59.218579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] Returning 404 to user: Instance 3fda981d-f498-4476-be14-b2b88a990533 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:46:59.218579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eb298e28-f99b-4a0b-9d1f-c9382955d312 tempest-VolumesSnapshotTestJSON-849826855 tempest-VolumesSnapshotTestJSON-849826855-project] 10.222.0.26 "GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533" status: 404 len: 111 microversion: 2.1 time: 0.030416 Oct 04 05:46:59.218579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 330/672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:46:59 2022] GET /compute/v2.1/servers/3fda981d-f498-4476-be14-b2b88a990533 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:47:10.107404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:10.109718 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:10.112124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=16 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:10.112780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:10.117348 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:10.117818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:10.118282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:10.118969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:10.119412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:10.119826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:10.357548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c8d5b30f-2fdb-4f08-a922-56b2ff44206d tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/action" status: 202 len: 0 microversion: 2.1 time: 0.254142 Oct 04 05:47:10.358189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 343/673] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:47:10 2022] POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:47:10.366200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:10.366845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:10.370423 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:10.371088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:10.375810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:10.376291 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:10.376784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:10.377474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:10.377927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:10.378379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:10.519961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:10.528951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-51028350-9a77-4549-b8fc-2187e6113bd9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1750 microversion: 2.1 time: 0.166656 Oct 04 05:47:10.530062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 331/674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:10 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:11.552949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:11.553673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:11.560310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:11.560790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:11.561226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:11.561910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:11.562643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:11.563070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:11.705111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:11.714097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ce554a31-ebab-47b0-b7f2-ad400fd493c8 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1750 microversion: 2.1 time: 0.165883 Oct 04 05:47:11.714678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 344/675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:11 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:12.736924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:12.737500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:12.744473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:12.744947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:12.745375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:12.746057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:12.746533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:12.746954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:12.885255 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:12.893715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-19b3deef-8d01-477b-81ad-290c9283d3e6 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1750 microversion: 2.1 time: 0.160812 Oct 04 05:47:12.894304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 332/676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:12 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:13.917539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:13.918210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:13.924985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:13.925720 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:13.926180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:13.926877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:13.927327 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:13.927748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:14.067750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:14.076029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5501c123-fc6e-496f-8ab5-905b220f0f7b tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.163160 Oct 04 05:47:14.076591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 345/677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:13 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:15.100049 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:15.100692 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:15.107225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:15.107705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:15.108143 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:15.108834 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:15.109309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:15.109734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:15.252131 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:15.260461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4ac30225-970f-4fae-8290-cd7222a86a9c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.164548 Oct 04 05:47:15.261030 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 333/678] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:15 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:16.284313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:16.284920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:16.291335 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:16.291812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:16.292290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:16.293025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:16.293479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:16.293902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:16.648100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:16.656276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bb72f288-0e33-488d-bcf4-bd19e7000f10 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.375906 Oct 04 05:47:16.656865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 346/679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:16 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:17.679565 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:17.680167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:17.686704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:17.687177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:17.687859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:17.688560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:17.688989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:17.689415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:17.827403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:17.835633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f92d9fe3-b545-45fc-885b-c983d63d71c9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.160104 Oct 04 05:47:17.836197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 334/680] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:17 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:18.642200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:18.642694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:18.648881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:18.649363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:18.649796 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:18.650502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:18.650951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:18.652045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:18.680746 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7881013f-7aae-44bc-9048-774537baad44 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments/80afebb8-eb83-4928-8484-31b39d0c9a7e" status: 200 len: 194 microversion: 2.20 time: 0.042387 Oct 04 05:47:18.681245 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 347/681] 10.222.0.26 () {60 vars in 1454 bytes} [Tue Oct 4 05:47:18 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments/80afebb8-eb83-4928-8484-31b39d0c9a7e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:47:18.752203 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:18.752721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:18.758907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:18.759386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:18.759814 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:18.760495 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:18.760967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:18.761383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:18.841592 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'services' on Instance uuid 73d72dc7-af42-4950-b7c2-3d617f22680c {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:47:18.859386 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:18.859985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:18.865910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:18.866403 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:18.866834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:18.867517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:18.867990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:18.868409 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:19.006716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:19.015563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2db5b0fc-b0b8-4135-9b73-2ee78355d059 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.159971 Oct 04 05:47:19.016130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 348/682] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:18 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:19.067179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b53de495-d5b5-4e49-a11d-dffc8faa04d9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments/80afebb8-eb83-4928-8484-31b39d0c9a7e" status: 202 len: 0 microversion: 2.20 time: 0.318745 Oct 04 05:47:19.067897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 335/683] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 4 05:47:18 2022] DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments/80afebb8-eb83-4928-8484-31b39d0c9a7e => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:47:19.076601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:19.078873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:19.084970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:19.085506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:19.085926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:19.086757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:19.087240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:19.087664 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:19.117437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9f450fb1-579e-4f89-9ca4-f13aebbccbe0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045268 Oct 04 05:47:19.117987 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 349/684] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 05:47:19 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:47:20.040699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:20.041386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:20.048424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:20.048901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:20.049337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:20.050013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:20.050494 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:20.050911 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:20.130363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:20.132494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:20.139060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:20.139532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:20.139960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:20.140642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:20.141083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:20.141503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:20.171523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8682402e-dfe8-4f6d-88cb-ac83689871bf tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045092 Oct 04 05:47:20.172245 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 350/685] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 05:47:20 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 05:47:20.195994 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:20.204285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-de68221e-1c02-4b91-a53e-493b3e3da38a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.168618 Oct 04 05:47:20.204873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 336/686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:20 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:21.184230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:21.186975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:21.193549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.194029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.194498 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.195186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.195636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.196062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.223961 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2c817925-09a5-46f2-ad60-dad047fdc48b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043796 Oct 04 05:47:21.224523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 351/687] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 05:47:21 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:21.227638 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:21.228250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:21.235714 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.236193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.236626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.237311 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.237762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.238199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.287486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:21.287981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:21.293916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.294428 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.294877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.296095 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.296549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.296977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.322886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:47:21.381776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:21.389984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5f251c20-8c52-4a70-820c-ec05167abeb9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.166140 Oct 04 05:47:21.390633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 337/688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:21 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:21.649180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4d715937-4738-4565-9143-b0f67a1e21fd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 204 len: 0 microversion: 2.20 time: 0.365268 Oct 04 05:47:21.649768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 352/689] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 05:47:21 2022] DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 05:47:21.658321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:21.658920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:21.664815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.665293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.665724 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.666437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:21.666883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:21.667303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:21.797721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:21.806026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:21.807509 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:21.808721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0da8a25f-d3da-4109-bd0a-6f748336e57b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.154751 Oct 04 05:47:21.809281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 338/690] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:21 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:22.413787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:22.414517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:22.420776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:22.421669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:22.421669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:22.422395 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:22.422848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:22.423279 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:22.566404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:22.574854 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2a6e9348-5cff-44d3-a138-dcbce4b9f4ec tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.165658 Oct 04 05:47:22.575422 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 353/691] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:22 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:22.834433 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:22.834962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:22.841261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:22.841744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:22.842224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:22.842905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:22.843348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:22.843764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:22.970077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:22.978419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:22.979870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:22.981079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-39e425ad-5c44-4087-816a-0eec14100333 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.150691 Oct 04 05:47:22.981814 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 339/692] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:22 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:23.598436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:23.599056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:23.605726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:23.610211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:23.610211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:23.610211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:23.610211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:23.610962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:23.757182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:23.765971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-26d3854e-a0c4-4bc3-b0fb-9bf2aadf85c0 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.171534 Oct 04 05:47:23.771223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 354/693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:23 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:24.006958 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:24.007496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:24.014725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:24.015069 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:24.015500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:24.016184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:24.016623 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:24.017040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:24.247715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:24.256818 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:24.258500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:24.259777 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1cadae5a-f850-4e18-9c06-0a050124ed68 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1722 microversion: 2.20 time: 0.256912 Oct 04 05:47:24.260443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 340/694] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:24 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:24.734359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-112bb0e7-d46f-4a93-8d86-b78cd0caf065 req-05f5cf94-57d9-4c61-98e9-54718a685ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d72dc7-af42-4950-b7c2-3d617f22680c", "name": "network-vif-deleted", "tag": "086c18f1-e72b-4f50-9c9e-e2d9be2fefb7"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:24.744406 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-112bb0e7-d46f-4a93-8d86-b78cd0caf065 req-05f5cf94-57d9-4c61-98e9-54718a685ea8 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:24.744887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-112bb0e7-d46f-4a93-8d86-b78cd0caf065 req-05f5cf94-57d9-4c61-98e9-54718a685ea8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:24.745373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-112bb0e7-d46f-4a93-8d86-b78cd0caf065 req-05f5cf94-57d9-4c61-98e9-54718a685ea8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:24.762905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-112bb0e7-d46f-4a93-8d86-b78cd0caf065 req-05f5cf94-57d9-4c61-98e9-54718a685ea8 service nova] Creating event network-vif-deleted:086c18f1-e72b-4f50-9c9e-e2d9be2fefb7 for instance 73d72dc7-af42-4950-b7c2-3d617f22680c on hv-cinder-84914 Oct 04 05:47:24.767895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-112bb0e7-d46f-4a93-8d86-b78cd0caf065 req-05f5cf94-57d9-4c61-98e9-54718a685ea8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Oct 04 05:47:24.769240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 355/695] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:24.792585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:24.793338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:24.801714 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:24.803974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:24.803974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:24.803974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:24.808982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:24.809789 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:24.981475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:24.992229 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eca40f7d-323b-4c10-b9e9-cf597ba9aeb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.206736 Oct 04 05:47:24.992881 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 341/696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:24 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:25.287300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:25.289017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:25.296371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:25.297376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:25.298170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:25.298927 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:25.299385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:25.299995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:25.345137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:25.345719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:25.346961 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:25.347960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'fault' on Instance uuid 73d72dc7-af42-4950-b7c2-3d617f22680c {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:47:25.397136 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:25.406763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:25.408352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:25.409717 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-931a36e2-8e6a-4f60-b923-07fe4c175847 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 200 len: 1370 microversion: 2.20 time: 0.128315 Oct 04 05:47:25.412549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 356/697] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:25 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 1370 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:26.016340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:26.016957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:26.023544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:26.024030 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:26.024467 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:26.025164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:26.025640 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:26.026063 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:26.186208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:26.194696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-32d55a7f-7902-4ee3-bfdf-981508b1f624 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.182827 Oct 04 05:47:26.195269 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 342/698] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:26 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:26.436617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:26.437768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:26.444506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:26.445022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:26.445451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:26.446134 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:26.446603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:26.447019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:26.451582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:26.465875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] HTTP exception thrown: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Request method failure captured: Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c HTTP/1.1 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZ2tXfrhvPqIvgpWmVJ-eJY5DD4LGbDFuuFAQroHWY7RGDYL6oHqDulhQuzHc51SMilf_uVieeVwG0N93ioFUyoKt-vGfLscw6fGTeL4LSSicN__F9vbPNQckmJlhJNEh5D1t7ZbGiiU3S1ARv8YdsMzVvnoWcsf02iAr611xWILQ Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:47:26.467606 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_636e6b38bf1d4736a38728488881e9d2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}] Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 6f1635c9c6cf4fb092c0f03a02e36174 Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:47:26.469412 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '73d72dc7-af42-4950-b7c2-3d617f22680c'} Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:47:26.470416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:47:26.471929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:26.473256 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Returning 404 to user: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:47:26.473256 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-919938b3-59f5-409c-b736-9d3af640ea6f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 404 len: 111 microversion: 2.20 time: 0.036980 Oct 04 05:47:26.473256 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 357/699] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:26 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:47:26.478131 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c10dc0c7-bdca-431d-9a51-33d91941862e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '.version_select at 0x7f04864413a0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:26.565418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c10dc0c7-bdca-431d-9a51-33d91941862e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19348087" status: 204 len: 0 microversion: 2.20 time: 0.091072 Oct 04 05:47:26.566184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 343/700] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 4 05:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19348087 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 05:47:27.218297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:27.218978 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:27.225259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:27.229117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:27.229117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:27.229117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:27.229117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:27.229520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:27.468125 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:27.477434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-baa0f2d0-1c65-4786-a1a7-457a57a4de88 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.263871 Oct 04 05:47:27.478005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 358/701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:27 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:27.547180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eb2df1ef-96f6-4587-b7c9-18292946b23c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'create', calling method: .version_select at 0x7f048643daf0>, body: {"keypair": {"name": "tempest-keypair-1592520745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrzYPTQHOqV8OsPHebgDihGWAI8/HJJOQnW2dPKPpa3pvmzrK94+H3OnpFVRn7lRBztBkTrosYrhYMUuIOavHm3NM6/1jGFDBwfLYBqMMUygeFIIiodHbPme0VKJbLhTQ=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:27.564304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-eb2df1ef-96f6-4587-b7c9-18292946b23c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for project 636e6b38bf1d4736a38728488881e9d2. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:47:27.568519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-eb2df1ef-96f6-4587-b7c9-18292946b23c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for user 6f1635c9c6cf4fb092c0f03a02e36174 and project 636e6b38bf1d4736a38728488881e9d2. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:47:27.652330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eb2df1ef-96f6-4587-b7c9-18292946b23c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.109555 Oct 04 05:47:27.653198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 344/702] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 4 05:47:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 05:47:28.503041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:28.503667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:28.510778 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:28.511264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:28.511703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:28.512407 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:28.512881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:28.513302 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:28.675691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:28.697485 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-efae28c2-ec87-4f8a-bafb-84606a556cfe tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.199145 Oct 04 05:47:28.698945 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 359/703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:28 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:28.743745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:28.745920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:28.752218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:28.752693 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:28.753465 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:28.754183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:28.754636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:28.755542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:28.789343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d868179c-3ebc-403a-b30b-5f86067d3697 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050046 Oct 04 05:47:28.790470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 345/704] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:47:28 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:47:28.854085 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:28.857708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:28.860811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:28.861291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:28.862026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:28.862744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:28.863200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:28.863625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:28.889587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:47:29.273336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-66034785-0bd4-447c-8cfd-fc59fcbf7803 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 204 len: 0 microversion: 2.1 time: 0.422739 Oct 04 05:47:29.273943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 360/705] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:47:28 2022] DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:47:29.282857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:29.283622 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:29.290891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:29.291548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:29.292098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:29.292977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:29.293536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:29.294062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:29.527887 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:29.536727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6dbd6112-6d61-44d4-9f6d-6d15ef41e45c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1672 microversion: 2.1 time: 0.257931 Oct 04 05:47:29.537407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 346/706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:29 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1672 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:29.723920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:29.725275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:29.733542 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:29.734316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:29.735052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:29.736006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:29.736699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:29.737335 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:29.933104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:29.942736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1a5705f4-e2a1-4906-a502-68c9a74c5c36 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.223624 Oct 04 05:47:29.943386 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 361/707] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:29 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:30.182720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-14914997", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cfb3053-30b6-4a8c-ab04-88f5f64c550f"}], "security_groups": [{"name": "tempest-securitygroup--1921619136"}], "key_name": "tempest-keypair-1592520745", "user_data": "}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:30.364490 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] validate_networks() for [('6cfb3053-30b6-4a8c-ab04-88f5f64c550f', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:47:30.561555 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:30.562360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:30.569169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:30.569767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:30.570542 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:30.571396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:30.578575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:30.578575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:30.722199 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:30.729425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0432a059-7a3d-48c9-968a-e548e3ce8c12 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1672 microversion: 2.1 time: 0.172173 Oct 04 05:47:30.734236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 362/708] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:30 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:30.967743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:30.968657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:30.976013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:30.976732 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:30.977667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:30.978577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:30.979221 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:30.979462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:47:30.980044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:30.980164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:47:30.980809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:47:30.981401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:47:30.981877 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:47:30.996551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:30.997656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:30.998763 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:31.000204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:31.000879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:31.001711 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:31.028254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for project 636e6b38bf1d4736a38728488881e9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:47:31.033166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Getting quotas for user 6f1635c9c6cf4fb092c0f03a02e36174 and project 636e6b38bf1d4736a38728488881e9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:47:31.046281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:47:31.048949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:47:31.144558 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4652e627-c417-43c7-8f12-67dec88cf12e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.966630 Oct 04 05:47:31.145218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 347/709] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 4 05:47:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 05:47:31.147465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:31.156433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-897cba9a-a690-4f2c-a573-8c8f6af44e52 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1755 microversion: 2.1 time: 0.193420 Oct 04 05:47:31.157041 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ee1b1ada-fb3c-47b1-bedc-c36a539117d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:31.157649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 363/710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:30 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:31.158981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ee1b1ada-fb3c-47b1-bedc-c36a539117d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:31.215170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ee1b1ada-fb3c-47b1-bedc-c36a539117d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:31.224025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ee1b1ada-fb3c-47b1-bedc-c36a539117d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:31.225576 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ee1b1ada-fb3c-47b1-bedc-c36a539117d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:31.226618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ee1b1ada-fb3c-47b1-bedc-c36a539117d1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1280 microversion: 2.20 time: 0.074280 Oct 04 05:47:31.242175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 348/711] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:31 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:31.723734 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb672ec1-c7da-4f11-ad8b-555ede98fe1b"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:31.726567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:31.734586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:31.735253 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:31.735625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:31.736601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:31.737329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:31.738219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:31.756667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:31.757863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:31.774300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:31.775940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:31.777636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:31.778658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:31.779405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:31.780676 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:32.106820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:32.115188 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4c563bef-31e8-49a4-b1a7-cb9af1fe58d6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1672 microversion: 2.1 time: 0.365661 Oct 04 05:47:32.116097 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 349/712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:31 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1672 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:32.181317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:32.182040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:32.189802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:32.190438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:32.190980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:32.191784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:32.192362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:32.192893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:32.212579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:32.377738 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:32.390539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-91f6e018-214c-40a0-bfd9-f6da6f12405a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1758 microversion: 2.1 time: 0.209846 Oct 04 05:47:32.390539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 350/713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:32 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1758 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:32.391481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:32.392077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:32.398250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:32.398738 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:32.399180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:32.399876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:32.400330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:32.400860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:32.481721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:32.490903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:32.492760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:32.494213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-681cb684-0980-4fc4-8f01-2784404324b0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1284 microversion: 2.20 time: 0.106135 Oct 04 05:47:32.495653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 351/714] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:32 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:33.142419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:33.144488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:33.158973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:33.160020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:33.160799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:33.161526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:33.162169 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:33.164496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:33.243625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ccc92703-cabe-46e5-a53c-e5169cb5b81f tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.524018 Oct 04 05:47:33.245257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 364/715] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:47:31 2022] POST /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments => generated 194 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:33.524567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:33.525808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:33.547533 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:33.548112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:33.549861 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:33.552295 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:33.553014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:33.557400 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:33.663702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:33.673762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:33.676743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:33.679970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:33.683873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4a92bbad-f375-44c8-8b85-e4e781bcabe7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1332 microversion: 2.20 time: 0.163701 Oct 04 05:47:33.685089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 365/716] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:33 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:47:33.686951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-41b2c7ff-558c-4c46-8d20-bb057722b361 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1672 microversion: 2.1 time: 0.550188 Oct 04 05:47:33.702008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 352/717] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:33 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1672 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:34.647128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-cfbd12ba-c305-4151-b501-8ebd7870c7fc req-3d08416e-1cee-4982-bf57-a592f29ee8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8f1069-3555-4673-a945-1e45b7a35999", "name": "network-vif-deleted", "tag": "5ced9537-26c4-4d6d-a357-ce2a56da3e84"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:34.667782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-cfbd12ba-c305-4151-b501-8ebd7870c7fc req-3d08416e-1cee-4982-bf57-a592f29ee8f2 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:34.672355 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-cfbd12ba-c305-4151-b501-8ebd7870c7fc req-3d08416e-1cee-4982-bf57-a592f29ee8f2 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:34.673273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-cfbd12ba-c305-4151-b501-8ebd7870c7fc req-3d08416e-1cee-4982-bf57-a592f29ee8f2 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:34.703297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-cfbd12ba-c305-4151-b501-8ebd7870c7fc req-3d08416e-1cee-4982-bf57-a592f29ee8f2 service nova] Creating event network-vif-deleted:5ced9537-26c4-4d6d-a357-ce2a56da3e84 for instance fb8f1069-3555-4673-a945-1e45b7a35999 on hv-cinder-84914 Oct 04 05:47:34.713171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:34.714585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:34.722845 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-cfbd12ba-c305-4151-b501-8ebd7870c7fc req-3d08416e-1cee-4982-bf57-a592f29ee8f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079422 Oct 04 05:47:34.723800 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 366/718] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:34.732031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:34.739038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:34.739188 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:34.740308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:34.740796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:34.745472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:34.745671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:34.746095 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:34.746587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:34.746900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:34.747325 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:34.747652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:34.747769 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:34.756588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:34.900629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:34.927853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0f0a8fb9-e528-4d94-922f-95ca43d282e9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1604 microversion: 2.1 time: 0.202798 Oct 04 05:47:34.932952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 367/719] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:34 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:34.938804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:34.955273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:34.956929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:34.958313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-97b7d104-8b91-4ac6-a301-d7087d2609a3 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1338 microversion: 2.20 time: 0.251182 Oct 04 05:47:34.972386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 353/720] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:34 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1338 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:35.956031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:35.957104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:35.964385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:35.965036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:35.965770 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:35.966665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:35.968157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:35.968811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:35.989357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:35.990736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:36.009628 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:36.013024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:36.013024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:36.013024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:36.013496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:36.013957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:36.024286 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:36.025163 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:36.025857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:36.026515 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid fb8f1069-3555-4673-a945-1e45b7a35999 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:47:36.098630 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:36.113591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-670aeaa7-bf4f-423f-be98-d09d09108f83 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 200 len: 1327 microversion: 2.1 time: 0.161984 Oct 04 05:47:36.114990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 368/721] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:35 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 1327 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:36.397131 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:36.409862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:36.411464 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:36.412709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2e17df07-5659-48b0-8786-677e5ed70a1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.427235 Oct 04 05:47:36.413457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 354/722] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:35 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:47:37.122769 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-3533e488-1281-41ca-90aa-1a831df41db1 req-a1bd505b-91a1-4d09-8e2d-67d974e66dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:37.133337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3533e488-1281-41ca-90aa-1a831df41db1 req-a1bd505b-91a1-4d09-8e2d-67d974e66dfc service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:37.133796 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3533e488-1281-41ca-90aa-1a831df41db1 req-a1bd505b-91a1-4d09-8e2d-67d974e66dfc service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:37.134240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3533e488-1281-41ca-90aa-1a831df41db1 req-a1bd505b-91a1-4d09-8e2d-67d974e66dfc service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:37.140710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:37.141303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:37.149815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:37.150316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:37.153028 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:37.157203 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:37.158417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:37.159992 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:37.171190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-3533e488-1281-41ca-90aa-1a831df41db1 req-a1bd505b-91a1-4d09-8e2d-67d974e66dfc service nova] Creating event network-changed:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:47:37.177783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-3533e488-1281-41ca-90aa-1a831df41db1 req-a1bd505b-91a1-4d09-8e2d-67d974e66dfc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059339 Oct 04 05:47:37.179188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 369/723] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:37.183126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] HTTP exception thrown: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Request method failure captured: Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 HTTP/1.1 Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8ffGYYGtFzyvibJ1Umqev0w65ywMWcJENp1SwNE9oYTfzsLvi9iRkE-fODBeFnAzEh6mPFuR7Wv3MsiC7x4R5Gq4M5moPOIkfp9n8bbPILsBS0INCw4mYxIs6PZ0X7EWDCEmXK9mb-EBBM7baXFo-U0W2iu012GGOYfPj5uC9Km1oo Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:47:37.184780 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7efd5ee13f094656992497528d761f2c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7efd5ee13f094656992497528d761f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}] Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 537981b1b3a14cb4b10f336ef0362358 Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:47:37.198243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'fb8f1069-3555-4673-a945-1e45b7a35999'} Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:47:37.199370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:47:37.200651 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:47:37.201783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Returning 404 to user: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:47:37.201783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-39899805-18ca-4126-adfc-eac7adfa5385 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 404 len: 111 microversion: 2.1 time: 0.057112 Oct 04 05:47:37.201783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 355/724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:37 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:47:37.206676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a7861c34-20ec-4e24-90cf-fcaf7a8e3858 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '.version_select at 0x7f04864745e0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:37.286684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a7861c34-20ec-4e24-90cf-fcaf7a8e3858 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097252279" status: 202 len: 0 microversion: 2.1 time: 0.085824 Oct 04 05:47:37.287722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 370/725] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 05:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097252279 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:47:37.438372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:37.438977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:37.445856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:37.446376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:37.447067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:37.448263 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:37.449031 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:37.449632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:38.131945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:38.143638 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:38.146164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:38.147957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a4041853-c2be-4367-9a24-6b4609971b51 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.714827 Oct 04 05:47:38.149364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 356/726] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:37 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:38.816909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-24430084-ec3c-4466-8994-1ce057789fb6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: .version_select at 0x7f04864690d0>, body: {"keypair": {"name": "tempest-keypair-1192253945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZbO+ad43mWNu0E9OnhQq6lmGYZFXeQdTJQ7yXmaxfThvRDg+Q2+I1JtbJzptLP9trW2U5NH/J4fotzxXsLJWkAmS7O6SWZxAiSezZnKWtFzm2HXwFSBsRMtyUpQPKt/A=="}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:38.837196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-24430084-ec3c-4466-8994-1ce057789fb6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for project 7efd5ee13f094656992497528d761f2c. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:47:38.841175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-24430084-ec3c-4466-8994-1ce057789fb6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for user 537981b1b3a14cb4b10f336ef0362358 and project 7efd5ee13f094656992497528d761f2c. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:47:38.939466 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-24430084-ec3c-4466-8994-1ce057789fb6 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129129 Oct 04 05:47:38.940067 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 371/727] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:47:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:39.176741 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:39.177313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:39.183854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:39.184340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:39.184788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:39.187486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:39.187486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:39.187486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:39.343608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:39.352209 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:39.353678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:39.354819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3cc2d66c-4b19-4fce-b962-2a72b61542df tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.182265 Oct 04 05:47:39.355390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 357/728] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:39 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:39.502407 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:39.503208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:39.514321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:39.517127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:39.517588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:39.518373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:39.518836 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:39.520307 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:39.566111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b9b1dd82-ab97-4fb5-bfe5-6e1ead7cd52f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/ips" status: 200 len: 150 microversion: 2.1 time: 0.068449 Oct 04 05:47:39.574369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 372/729] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:47:39 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:40.380512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:40.381740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:40.388878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:40.389601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:40.390339 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:40.396280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:40.396280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:40.396280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:40.525246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:40.534346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:40.538485 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:40.538485 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-90fb712e-3e05-418d-86ae-d1b0fff17920 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.160468 Oct 04 05:47:40.538485 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 358/730] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:40 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:41.362227 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e1d00eb-9d77-4890-8f03-7403d03212bd"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:41.364517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:41.367149 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:41.373013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:41.374012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:41.379381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:41.379381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:41.379381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:41.379381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:41.567095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:41.569533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:41.573056 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:41.578770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=12 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:41.578770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:41.581317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:41.582280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:41.583366 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:41.584319 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:41.584831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:41.585562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:41.958504 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:41.964193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:41.966252 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:41.968351 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5d247390-b147-4e77-87c3-eea22e019479 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.410113 Oct 04 05:47:41.969104 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 359/731] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:41 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:47:42.138945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:42.141750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:42.148599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:42.149122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:42.149555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:42.150318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:42.150766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:42.151185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:42.178857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'flavor' on Instance uuid 6ef1eaae-b386-4ce1-9d08-63972bda8851 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:47:42.503066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:42.620980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ac8925d1-2e67-4ee3-a5a1-7b7913b6eada tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/action" status: 200 len: 32 microversion: 2.1 time: 0.486713 Oct 04 05:47:42.637719 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 360/732] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:47:42 2022] POST /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:47:42.649801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-996638073", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c03165e1-beb9-4a5b-abe8-8381d5e7772e"}], "security_groups": [{"name": "tempest-securitygroup--1883976611"}], "key_name": "tempest-keypair-1192253945", "user_data": "}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:42.697663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-893fffd3-256a-4371-be0a-28e4c11df2cb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.336201 Oct 04 05:47:42.716134 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 373/733] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:47:41 2022] POST /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments => generated 194 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:42.729676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:42.732463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:42.755936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:42.757834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:42.760523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:42.763503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:42.767586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:42.770004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:42.923890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] validate_networks() for [('c03165e1-beb9-4a5b-abe8-8381d5e7772e', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:47:43.093467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:43.105445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1e3e9af1-cb00-4271-860e-a3d7f3e7d6f0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.385742 Oct 04 05:47:43.106118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 374/734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:42 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:43.112669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:43.113521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:43.120378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:43.121326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:43.121953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:43.123460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:43.124092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:43.124705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:43.292697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:43.293563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:43.296085 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:43.297636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d52fa90a-2208-4e15-8b90-fc1351fe7a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.189161 Oct 04 05:47:43.298226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 375/735] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:43 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:43.585468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ad3e008c-e3dc-45fe-b5ec-6c97cf4daa3c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Action: 'create', calling method: .version_select at 0x7f0489e39550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-495012344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcZkCgdEPKuk+yHmbpDpiTGxUFw3B4PoQvvXOFzRiuSQhKxz4MNjNqdYbshKggpAxofFe1ScGf/B9+L6BKFCza1HHH4dMOEIUy5yH1UMD6VYGJYXLQXAGimw1sg+qqXYw=="}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:43.602838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-ad3e008c-e3dc-45fe-b5ec-6c97cf4daa3c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:47:43.606917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-ad3e008c-e3dc-45fe-b5ec-6c97cf4daa3c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for user 0c0c0a25340a451b970cc3de8bc05806 and project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'key_pairs'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:47:43.690781 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ad3e008c-e3dc-45fe-b5ec-6c97cf4daa3c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.231073 Oct 04 05:47:43.691478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 376/736] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:47:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:44.104542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:47:44.105046 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:47:44.105412 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:47:44.105889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:47:44.106405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:47:44.124577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.126361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.126361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.127393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.133643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.134200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:44.134480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.135264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:44.143846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.144346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.144796 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.145493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.146122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.146577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.161782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for project 7efd5ee13f094656992497528d761f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:47:44.164998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Getting quotas for user 537981b1b3a14cb4b10f336ef0362358 and project 7efd5ee13f094656992497528d761f2c. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:47:44.178214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:47:44.193273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:47:44.352396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:44.361415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a7e41263-c3fc-4e3b-8aaf-4b21de4435cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.233628 Oct 04 05:47:44.373874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 377/737] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:44 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:44.373874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-85610b9e-a3a7-4cb0-9407-29c5e337bb48 req-18bd3f45-c440-4935-8236-2ffa162d2a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "name": "network-vif-plugged", "status": "completed", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:44.376995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-85610b9e-a3a7-4cb0-9407-29c5e337bb48 req-18bd3f45-c440-4935-8236-2ffa162d2a00 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.377469 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-85610b9e-a3a7-4cb0-9407-29c5e337bb48 req-18bd3f45-c440-4935-8236-2ffa162d2a00 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.377901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-85610b9e-a3a7-4cb0-9407-29c5e337bb48 req-18bd3f45-c440-4935-8236-2ffa162d2a00 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.390000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-85610b9e-a3a7-4cb0-9407-29c5e337bb48 req-18bd3f45-c440-4935-8236-2ffa162d2a00 service nova] Creating event network-vif-plugged:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:47:44.401188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-85610b9e-a3a7-4cb0-9407-29c5e337bb48 req-18bd3f45-c440-4935-8236-2ffa162d2a00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037821 Oct 04 05:47:44.402107 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 378/738] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:44.407803 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:44.407929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:44.414171 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.414659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.415087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.415837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:44.416144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0eef284e-7c36-4091-8086-6019dd6f022b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.776320 Oct 04 05:47:44.416287 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:44.416711 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:44.416830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 361/739] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:47:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:47:44.429805 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-73fc4521-beed-4005-8b83-99bcb5ecabaa tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:44.430450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-73fc4521-beed-4005-8b83-99bcb5ecabaa tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:44.513946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-73fc4521-beed-4005-8b83-99bcb5ecabaa tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:44.525376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-73fc4521-beed-4005-8b83-99bcb5ecabaa tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1237 microversion: 2.1 time: 0.099732 Oct 04 05:47:44.530772 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 362/740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:44 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:44.630479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:44.637315 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:44.638943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:44.640418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2277b031-f369-4cf2-9463-3b56882f6143 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.237209 Oct 04 05:47:44.641790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 379/741] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:44 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:45.388016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:45.393979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:45.406492 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:45.406979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:45.407414 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:45.408118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:45.408566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:45.408989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:45.547517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:45.548124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:45.563324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:45.563324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:45.563324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:45.563324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:45.563871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:45.563871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:45.637859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:45.652484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e498121a-972c-4b5c-a9ef-147db56081d3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1241 microversion: 2.1 time: 0.107221 Oct 04 05:47:45.653218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 380/742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:45 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:45.682867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:45.682867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:45.696514 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:45.698337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:45.699783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:45.706261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:45.709326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:45.710424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:45.779802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:45.791534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8b1aa51b-6364-4b46-9a4a-386f14c98136 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.404772 Oct 04 05:47:45.791534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 363/743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:45 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:45.885071 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:45.894835 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:45.895457 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:45.896568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c38dec87-f47c-4e1f-9f7f-843068bd2f6c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1406 microversion: 2.20 time: 0.232451 Oct 04 05:47:45.897120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 381/744] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:45 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:47:46.675500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:46.676109 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:46.686439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:46.686968 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:46.687404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:46.699118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:46.699594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:46.700030 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:46.780164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:46.789223 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bfdff20e-2a15-42af-8c62-5e8e8aec4f47 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1233 microversion: 2.1 time: 0.117480 Oct 04 05:47:46.791206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 364/745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:46 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1233 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:46.815888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:46.816503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:46.823419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:46.823913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:46.824549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:46.825265 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:46.825720 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:46.826705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:46.923793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:46.924784 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:46.931904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:46.936103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:46.936103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:46.936103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:46.936103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:46.936887 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:47.008361 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:47.020201 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9ab80087-9bb9-418e-a317-d6e01686b36a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.208160 Oct 04 05:47:47.022161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 382/746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:46 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:47.201656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:47.210564 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:47.212534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:47.213718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ed5f156b-9411-485b-b5ce-5ba60780c23f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1597 microversion: 2.20 time: 0.295975 Oct 04 05:47:47.214464 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 365/747] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:47:46 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1597 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:47:47.243662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:47.244146 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:47.251278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:47.251985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:47.252602 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:47.253472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:47.254377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:47.255016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:47.347472 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-82bc32af-bc2b-418b-aefa-99ab2cff6231 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107794 Oct 04 05:47:47.352450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 383/748] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 4 05:47:47 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:47:47.812172 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:47.812726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:47.819386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:47.819870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:47.820301 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:47.821187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:47.821801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:47.822412 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:47.897268 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:47.906624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a471cbad-31a0-42c8-a7fe-52e95539ef1b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1289 microversion: 2.1 time: 0.098515 Oct 04 05:47:47.907201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 366/749] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:47 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:48.059705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:48.060364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:48.079673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:48.087756 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:48.089573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:48.092815 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:48.094098 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:48.101242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:48.365077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:48.374320 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-62c418ba-96e4-4d7a-8df0-15190f350f9a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.334046 Oct 04 05:47:48.375989 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 384/750] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:48 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:48.634439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-5c1eb166-1661-42bf-ab6d-adef5abfd747 req-576948bd-530d-4152-9608-6c8673538bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:48.653334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-5c1eb166-1661-42bf-ab6d-adef5abfd747 req-576948bd-530d-4152-9608-6c8673538bbd service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:48.654042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-5c1eb166-1661-42bf-ab6d-adef5abfd747 req-576948bd-530d-4152-9608-6c8673538bbd service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:48.658052 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-5c1eb166-1661-42bf-ab6d-adef5abfd747 req-576948bd-530d-4152-9608-6c8673538bbd service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:48.677993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-5c1eb166-1661-42bf-ab6d-adef5abfd747 req-576948bd-530d-4152-9608-6c8673538bbd service nova] Creating event network-changed:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:47:48.688850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-5c1eb166-1661-42bf-ab6d-adef5abfd747 req-576948bd-530d-4152-9608-6c8673538bbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058025 Oct 04 05:47:48.689742 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 367/751] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:48.930255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:48.930255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:48.937188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:48.937812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:48.938650 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:48.939576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:48.940340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:48.941860 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:49.098557 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:49.106565 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8f2687ab-90b4-46a8-9fe0-cc8c03c6e510 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.181517 Oct 04 05:47:49.108426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 385/752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:48 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:49.399364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:49.400185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:49.407218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:49.407690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:49.408301 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:49.409053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:49.409775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:49.410386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:49.415066 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:49.694750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:49.712447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b3b7db33-cd54-458c-b753-78b0e0cdabd5 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.317104 Oct 04 05:47:49.713648 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 368/753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:49 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:50.130843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:50.131461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:50.138291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:50.139334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:50.139824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:50.140684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:50.141262 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:50.141905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:50.296842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:50.304852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d4d7b514-b11b-4417-a195-1700f4ffb9a5 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.177915 Oct 04 05:47:50.314814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 386/754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:50 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:50.641225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-b03869f6-3761-43b3-a7ac-c97f5fd83326 req-d9b39335-7124-434b-85ab-f5063fdb7b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a0814e-8898-4c71-87fc-1ced0aa84ba4", "tag": "cc21ab55-5520-44ff-9fa8-6eca7297581f"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:50.652278 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b03869f6-3761-43b3-a7ac-c97f5fd83326 req-d9b39335-7124-434b-85ab-f5063fdb7b78 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:50.653389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b03869f6-3761-43b3-a7ac-c97f5fd83326 req-d9b39335-7124-434b-85ab-f5063fdb7b78 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:50.653863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b03869f6-3761-43b3-a7ac-c97f5fd83326 req-d9b39335-7124-434b-85ab-f5063fdb7b78 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:50.671020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-b03869f6-3761-43b3-a7ac-c97f5fd83326 req-d9b39335-7124-434b-85ab-f5063fdb7b78 service nova] Creating event network-changed:cc21ab55-5520-44ff-9fa8-6eca7297581f for instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 on hv-cinder-84914 Oct 04 05:47:50.677144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-b03869f6-3761-43b3-a7ac-c97f5fd83326 req-d9b39335-7124-434b-85ab-f5063fdb7b78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039408 Oct 04 05:47:50.677851 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 369/755] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:47:50.740717 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:50.741333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:50.751868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:50.766185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:50.766185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:50.766185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:50.766185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:50.766814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:50.914180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:50.931448 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b90b53c5-7931-4b73-b4e3-28f7f2164275 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.195419 Oct 04 05:47:50.932312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 387/756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:50 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:51.329711 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:51.330367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:51.337534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.338122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.338626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.339321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.339773 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.340196 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.569820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:51.584027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bdfbe094-7939-436f-ad8b-fe767c75ee54 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.259308 Oct 04 05:47:51.584616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 370/757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:51 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:51.655706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e1d00eb-9d77-4890-8f03-7403d03212bd"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:51.658511 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:51.665625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.666102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.666566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.667257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.667704 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.668125 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.756558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Invalid volume: volume 4e1d00eb-9d77-4890-8f03-7403d03212bd is already attached to instances: edc3ace6-a575-4b82-8b82-a578d13bb43c Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: POST /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments HTTP/1.1 Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 74 Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:47:51.758228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {"volumeAttachment": {"volumeId": "4e1d00eb-9d77-4890-8f03-7403d03212bd"}} Oct 04 05:47:51.763190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Invalid volume: volume 4e1d00eb-9d77-4890-8f03-7403d03212bd is already attached to instances: edc3ace6-a575-4b82-8b82-a578d13bb43c Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'server_id': 'edc3ace6-a575-4b82-8b82-a578d13bb43c', 'body': {'volumeAttachment': {'volumeId': '4e1d00eb-9d77-4890-8f03-7403d03212bd'}}} Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e1d00eb-9d77-4890-8f03-7403d03212bd is already attached to instances: edc3ace6-a575-4b82-8b82-a578d13bb43c Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:51.764576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e1d00eb-9d77-4890-8f03-7403d03212bd is already attached to instances: edc3ace6-a575-4b82-8b82-a578d13bb43c Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:47:51.766021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e1d00eb-9d77-4890-8f03-7403d03212bd is already attached to instances: edc3ace6-a575-4b82-8b82-a578d13bb43c Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 400 to user: Invalid volume: volume 4e1d00eb-9d77-4890-8f03-7403d03212bd is already attached to instances: edc3ace6-a575-4b82-8b82-a578d13bb43c {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d51d05cb-15c6-40bc-89b3-961fb53cacb8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108408 Oct 04 05:47:51.767703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 388/758] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:47:51 2022] POST /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:47:51.835296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:51.835839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:51.842568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.843141 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.843587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.844354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.844810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.845289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.932574 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'services' on Instance uuid edc3ace6-a575-4b82-8b82-a578d13bb43c {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:47:51.958451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:51.959028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:51.965230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.965714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.969394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:51.969394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:51.969394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:51.969394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:52.110592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:52.119694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-773aec95-42cb-4c86-9a28-c67daa76b526 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.165158 Oct 04 05:47:52.120270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 389/759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:51 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:52.152904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f7fef7a8-e3dd-4f1b-952f-a13c5c5e17d9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments/4e1d00eb-9d77-4890-8f03-7403d03212bd" status: 202 len: 0 microversion: 2.1 time: 0.323377 Oct 04 05:47:52.153522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 371/760] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:47:51 2022] DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments/4e1d00eb-9d77-4890-8f03-7403d03212bd => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:47:52.161940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:52.164162 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:52.170726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:52.171201 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:52.171633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:52.172312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:52.172758 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:52.173176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:52.204408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1de8a700-0a5e-45d0-b194-854b467f0291 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046366 Oct 04 05:47:52.204957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 390/761] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:47:52 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:52.608768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:52.609455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:52.615679 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:52.616150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:52.616580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:52.617254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:52.617846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:52.618113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:52.750995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:52.759448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-34880ef9-a3fe-4fc1-8a3c-a45d0707575b tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.154854 Oct 04 05:47:52.760025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 372/762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:52 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:53.144442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:53.145052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:53.151656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:53.152151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:53.152636 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:53.153394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:53.154427 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:53.154839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:53.217438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:53.219765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:53.227010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:53.227482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:53.227911 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:53.228602 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:53.229044 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:53.229461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:53.259426 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9746ceac-2843-4fd2-8fe0-55406a1ef188 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Oct 04 05:47:53.259989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 373/763] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:47:53 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:47:53.289702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:53.299067 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8f0e98bf-c159-43d8-80f5-d26d52d96e69 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.158565 Oct 04 05:47:53.299632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 391/764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:53 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:53.782079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:53.782699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:53.788661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:53.789123 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:53.789552 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:53.790254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:53.790697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:53.791112 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:53.922418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:53.930929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ef537083-2573-49f5-a34b-55897fea69cc tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.152755 Oct 04 05:47:53.931502 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 374/765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:53 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:54.272491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:54.274669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:54.276740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=8 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:54.282034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.282544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.282995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.283952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.284134 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.284569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.289215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:54.316438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-43aefe2f-99be-4dde-99c6-ea097f0dc2f3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047882 Oct 04 05:47:54.316928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 392/766] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:47:54 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 05:47:54.323049 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:54.324299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:54.327809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:54.331580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.332074 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.332508 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.333202 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.333647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.334065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.386326 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:54.386936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:54.395483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.395976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.396418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.397127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.397584 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.398012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.424101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:47:54.473550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:54.482675 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-420439e3-3c95-4fac-91e4-173666ef9796 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.163834 Oct 04 05:47:54.483250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 375/767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:54 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:54.700830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1f32dda0-f232-465e-90bd-866c977df3c4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 204 len: 0 microversion: 2.1 time: 0.318846 Oct 04 05:47:54.702207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 393/768] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:47:54 2022] DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 05:47:54.710599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:54.711325 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:54.714553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=8 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:47:54.718376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.718982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.719518 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.720289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.721362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.721966 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.858565 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:54.866464 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2773c860-b139-4d88-85c9-c420e8e9ab50 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1680 microversion: 2.1 time: 0.159719 Oct 04 05:47:54.867258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 376/769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:54 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:54.955259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:54.956035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:54.963171 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.963657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.964103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:54.964808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:54.965267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:54.965689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:55.102655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:55.111467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c50a1553-2770-4394-9258-dabb7bc19aee tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.160700 Oct 04 05:47:55.112011 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 394/770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:54 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:55.506312 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:55.506909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:55.513281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:55.513755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:55.514207 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:55.514886 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:55.515327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:55.515744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:55.645979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:55.655497 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0a23641b-3188-495b-b38a-6c5ebfe14446 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.152483 Oct 04 05:47:55.656167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 377/771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:55 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:55.891221 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:55.891834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:55.898743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:55.899223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:55.899654 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:55.900342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:55.900789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:55.901235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:56.041339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:56.049305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d29f6ee7-e6a5-4eee-94a9-f78500d1e005 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1680 microversion: 2.1 time: 0.162403 Oct 04 05:47:56.049932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 395/772] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:55 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:56.135454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:56.136052 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:56.142729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:56.143140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:56.143569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:56.144254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:56.144699 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:56.145118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:56.219371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-3c8fdede-6432-4376-a21e-bd37ba75e979 req-8469b77d-811e-4fd3-9ea5-c5c231e3f9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a0814e-8898-4c71-87fc-1ced0aa84ba4", "name": "network-vif-plugged", "status": "completed", "tag": "cc21ab55-5520-44ff-9fa8-6eca7297581f"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:56.229350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3c8fdede-6432-4376-a21e-bd37ba75e979 req-8469b77d-811e-4fd3-9ea5-c5c231e3f9ad service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:56.229821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3c8fdede-6432-4376-a21e-bd37ba75e979 req-8469b77d-811e-4fd3-9ea5-c5c231e3f9ad service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:56.230369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-3c8fdede-6432-4376-a21e-bd37ba75e979 req-8469b77d-811e-4fd3-9ea5-c5c231e3f9ad service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:56.242092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-3c8fdede-6432-4376-a21e-bd37ba75e979 req-8469b77d-811e-4fd3-9ea5-c5c231e3f9ad service nova] Creating event network-vif-plugged:cc21ab55-5520-44ff-9fa8-6eca7297581f for instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 on hv-cinder-84914 Oct 04 05:47:56.247183 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-3c8fdede-6432-4376-a21e-bd37ba75e979 req-8469b77d-811e-4fd3-9ea5-c5c231e3f9ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 Oct 04 05:47:56.247772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 396/773] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:47:56.283820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:56.291595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5bf4c89e-2fd1-4446-85e8-2c6c0e595998 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.160143 Oct 04 05:47:56.292165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 378/774] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:56 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:56.679649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:56.680264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:56.687146 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:56.690801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:56.690801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:56.690801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:56.690801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:56.691249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:56.828060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:56.836771 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ea86efca-e19d-4da5-8ddc-13787fe5c373 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.161522 Oct 04 05:47:56.837344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 397/775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:56 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:57.073673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:57.074356 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:57.082114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:57.082653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:57.083090 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:57.083803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:57.084258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:57.084686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:57.371353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:57.371958 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:57.378602 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:57.379080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:57.379507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:57.380191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:57.380639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:57.381057 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:57.477025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:57.485968 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-de97f009-9126-4be9-ae82-3f1965f9c505 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1680 microversion: 2.1 time: 0.416632 Oct 04 05:47:57.486762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 379/776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:57 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1680 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:57.514111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:57.522787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1fffde4f-f340-4566-a3fb-438db8590738 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1363 microversion: 2.1 time: 0.212299 Oct 04 05:47:57.526633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 398/777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:57 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:57.860745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:57.861559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:57.867924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:57.868483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:57.869003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:57.869761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:57.870358 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:57.870836 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.091577 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:58.102527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2d90103d-3aa5-4572-a312-6d1e3d26670e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.245543 Oct 04 05:47:58.107673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 380/778] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:57 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:58.141828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-4531ffb7-cca9-466e-a804-57e8e701e1ac req-fe7f4f1f-f95c-4d59-98dc-f892264c13ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc3ace6-a575-4b82-8b82-a578d13bb43c", "name": "network-vif-deleted", "tag": "85eef61c-7813-4495-a4cb-e1f1f1d9d6f1"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:47:58.151637 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-4531ffb7-cca9-466e-a804-57e8e701e1ac req-fe7f4f1f-f95c-4d59-98dc-f892264c13ef service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.152105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-4531ffb7-cca9-466e-a804-57e8e701e1ac req-fe7f4f1f-f95c-4d59-98dc-f892264c13ef service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.156697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-4531ffb7-cca9-466e-a804-57e8e701e1ac req-fe7f4f1f-f95c-4d59-98dc-f892264c13ef service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.167441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-4531ffb7-cca9-466e-a804-57e8e701e1ac req-fe7f4f1f-f95c-4d59-98dc-f892264c13ef service nova] Creating event network-vif-deleted:85eef61c-7813-4495-a4cb-e1f1f1d9d6f1 for instance edc3ace6-a575-4b82-8b82-a578d13bb43c on hv-cinder-84914 Oct 04 05:47:58.172780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-4531ffb7-cca9-466e-a804-57e8e701e1ac req-fe7f4f1f-f95c-4d59-98dc-f892264c13ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035272 Oct 04 05:47:58.173955 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 399/779] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:58.509802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:58.510441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:58.517144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.517607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.518043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.518771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.519226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.519653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.549545 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:58.550508 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:58.557493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.558072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.558643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.559424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.559954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.560492 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.587141 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:58.595010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c25ca92f-a9e0-4122-ba27-404aab2f268c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1326 microversion: 2.1 time: 0.089061 Oct 04 05:47:58.595586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 381/780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:58 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:58.701028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:58.709023 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-de1a06df-6757-4ae6-a9b8-8918680e15ec tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1548 microversion: 2.1 time: 0.163761 Oct 04 05:47:58.709666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 400/781] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:58 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:47:58.733491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:58.733982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:58.740192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.740673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.741107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.741797 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:58.742301 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:58.742752 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:58.826939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cf1cfd13-aaf4-4b9c-b92c-c73587515938 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097725 Oct 04 05:47:58.827517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 382/782] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:47:58 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:47:59.127552 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:59.128622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:59.136624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:59.137223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:59.137959 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:59.138816 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:59.140164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:59.140942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:59.569712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:59.578632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ec23820f-6d8d-4270-b79e-8cbe19efeaca tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.455478 Oct 04 05:47:59.579256 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 401/783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:59 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:47:59.618640 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:47:59.619257 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:47:59.625428 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:59.625913 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:59.626377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:59.627064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:59.627605 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:59.628027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:59.661058 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:47:59.661523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:47:59.661951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:47:59.662417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid edc3ace6-a575-4b82-8b82-a578d13bb43c {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:47:59.707438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:47:59.715064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4d99ed5c-8bbe-478b-b696-3d7fda5ed80d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 200 len: 1331 microversion: 2.1 time: 0.100749 Oct 04 05:47:59.715635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 383/784] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:47:59 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:00.133165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-da430f77-29df-4031-b21d-b5ef61b95d01 req-9dde334c-9bc8-4397-a4f5-2f4f9f9c07dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a0814e-8898-4c71-87fc-1ced0aa84ba4", "tag": "cc21ab55-5520-44ff-9fa8-6eca7297581f"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:00.142486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-da430f77-29df-4031-b21d-b5ef61b95d01 req-9dde334c-9bc8-4397-a4f5-2f4f9f9c07dd service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:00.142957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-da430f77-29df-4031-b21d-b5ef61b95d01 req-9dde334c-9bc8-4397-a4f5-2f4f9f9c07dd service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:00.143383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-da430f77-29df-4031-b21d-b5ef61b95d01 req-9dde334c-9bc8-4397-a4f5-2f4f9f9c07dd service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:00.154451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-da430f77-29df-4031-b21d-b5ef61b95d01 req-9dde334c-9bc8-4397-a4f5-2f4f9f9c07dd service nova] Creating event network-changed:cc21ab55-5520-44ff-9fa8-6eca7297581f for instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 on hv-cinder-84914 Oct 04 05:48:00.159416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-da430f77-29df-4031-b21d-b5ef61b95d01 req-9dde334c-9bc8-4397-a4f5-2f4f9f9c07dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029788 Oct 04 05:48:00.162200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 402/785] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:00.602171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:00.602792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:00.609422 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:00.609909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:00.610571 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:00.611472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:00.611925 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:00.612352 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:00.739377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:00.741168 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:00.748118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:00.749392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:00.750374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:00.751092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:00.751550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:00.751999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:00.766445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c HTTP/1.1 Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:48:00.768115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:48:00.769464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'edc3ace6-a575-4b82-8b82-a578d13bb43c'} Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:48:00.770236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:48:00.772642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:00.775610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:48:00.775610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5b2160a4-0166-4c71-ae34-7e61e3cd5b79 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 404 len: 111 microversion: 2.1 time: 0.036123 Oct 04 05:48:00.775610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 403/786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:00 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:48:00.778599 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d02376f4-f521-4495-a87e-50ceb9146d32 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '.version_select at 0x7f0489df2b80>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:00.807274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:00.811458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:00.817108 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1449dc3f-553f-4001-9d41-30b0ae22282c tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.218835 Oct 04 05:48:00.818043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 384/787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:00 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:00.846270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d02376f4-f521-4495-a87e-50ceb9146d32 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812599921" status: 202 len: 0 microversion: 2.1 time: 0.071343 Oct 04 05:48:00.847031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 404/788] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 05:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812599921 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:48:01.582161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a32ec090-76c5-4ff5-a79d-239ee3e70f29 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: .version_select at 0x7f0486392d30>, body: {"keypair": {"name": "tempest-keypair-2093795458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMslTmV/PZpaDhzT+e/j/EaDHpLJw718ONi1PxFOoWpOhDrhCykt5v/KVEDgz9eGRNBS6Vxf8zdebnWKlmdSiW5xaanHPQlU6C/U/UCA5+Dy9ioENH/t0n8G6vhIbbkG7A=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:01.598785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-a32ec090-76c5-4ff5-a79d-239ee3e70f29 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:48:01.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-a32ec090-76c5-4ff5-a79d-239ee3e70f29 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:48:01.701912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a32ec090-76c5-4ff5-a79d-239ee3e70f29 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123265 Oct 04 05:48:01.702561 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 385/789] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:48:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:01.841543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:01.842730 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:01.851649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:01.852056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:01.852489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:01.853181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:01.853713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:01.854089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:01.988691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:01.997063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-db9ce6de-e9af-4a5b-8200-011d27aaf606 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.160105 Oct 04 05:48:01.997619 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 405/790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:01 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:03.021773 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:03.022600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:03.028847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:03.029327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:03.030365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:03.031060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:03.031511 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:03.031960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:03.224627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:03.233068 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a906e188-78e4-4664-a030-d2e6151d30da tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.215941 Oct 04 05:48:03.233644 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 386/791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:03 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:03.604390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2115901258", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495012344", "security_groups": [{"name": "tempest-secgroup-smoke-1310825236"}], "block_device_mapping_v2": [{"uuid": "ea48232b-80b4-445a-8398-7b09f260b7c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79e2bf3e-1f66-495f-8ec9-26b178e13978"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:03.719147 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] validate_networks() for [('79e2bf3e-1f66-495f-8ec9-26b178e13978', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:48:04.136394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:48:04.136826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:48:04.137329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:48:04.137764 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:48:04.138243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:48:04.148598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:04.149093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:04.149780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:04.150554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:04.151656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:04.152029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:04.170724 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:48:04.175102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for user 0c0c0a25340a451b970cc3de8bc05806 and project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:48:04.178175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1098190799", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c58c152-65b4-475d-9100-474584bb25cf"}], "security_groups": [{"name": "tempest-securitygroup--1374561063"}], "key_name": "tempest-keypair-2093795458", "user_data": "}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:04.235846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:48:04.237828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea48232b-80b4-445a-8398-7b09f260b7c0',volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:48:04.284334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.network.neutron [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] validate_networks() for [('2c58c152-65b4-475d-9100-474584bb25cf', None, None, None, None, None)] {{(pid=127393) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:48:04.577244 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:04.681697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ec5bdaf3-9221-4bde-83ff-068bf7b66725 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.081249 Oct 04 05:48:04.683126 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 406/792] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:48:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:48:04.688017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:04.688943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:04.695739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:04.696690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:04.697234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:04.698115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:04.698686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:04.699184 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:04.711554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:48:04.711554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image limits 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:48:04.712093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Flavor pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:48:04.712706 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Image pref 0:0:0 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:48:04.713117 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.virt.hardware [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:48:04.723332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:04.724141 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:04.724576 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:04.725303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:04.725750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:04.726201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:04.743568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:48:04.747686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Getting quotas for user c66c7ddbf18d4f1fb8c890f548031f40 and project f7b850d4b5df4a4e93720cb855add44f. Resources: {'instances', 'cores', 'ram'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:48:04.760971 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Going to run 1 instances... {{(pid=127393) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:48:04.763347 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:48:04.775642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:04.836137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:04.845059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ddd2a83a-a967-4cf1-bd80-6f8b3b077106 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.160710 Oct 04 05:48:04.854376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 407/793] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:04 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:04.854376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ee05a978-79ad-4a99-b072-55e4130b934e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:04.854376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ee05a978-79ad-4a99-b072-55e4130b934e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:04.909036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ee05a978-79ad-4a99-b072-55e4130b934e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:04.913855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ee05a978-79ad-4a99-b072-55e4130b934e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1094 microversion: 2.1 time: 0.067307 Oct 04 05:48:04.914435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 408/794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:04 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:04.960570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f762d5c7-bca2-4a75-bd03-b0effcb59aa3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.788685 Oct 04 05:48:04.961716 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 387/795] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:48:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:48:04.972595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0da27c30-e26a-49ca-b662-56e15f79d445 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:04.973198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0da27c30-e26a-49ca-b662-56e15f79d445 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:05.034743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0da27c30-e26a-49ca-b662-56e15f79d445 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:05.042630 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0da27c30-e26a-49ca-b662-56e15f79d445 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1242 microversion: 2.1 time: 0.073727 Oct 04 05:48:05.043393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 409/796] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:04 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:05.869271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:05.869863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:05.876717 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:05.877230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:05.877670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:05.878391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:05.878847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:05.879271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:05.935932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4e2f736e-fe0f-421d-b98a-868fb6c6c2f6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:05.936534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4e2f736e-fe0f-421d-b98a-868fb6c6c2f6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:05.990983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4e2f736e-fe0f-421d-b98a-868fb6c6c2f6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:05.998891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4e2f736e-fe0f-421d-b98a-868fb6c6c2f6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1094 microversion: 2.1 time: 0.066271 Oct 04 05:48:05.999852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 410/797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:05 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:06.035207 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:06.043248 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d4c77232-a815-4f58-828d-7b8aa1732ad1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.179309 Oct 04 05:48:06.043824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 388/798] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:05 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:06.065723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:06.066375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:06.072888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:06.073310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:06.073747 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:06.074474 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:06.074931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:06.075362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:06.138832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:06.146512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0ccb5a9d-17be-4378-b807-c3aaaa890019 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1246 microversion: 2.1 time: 0.085640 Oct 04 05:48:06.147072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 411/799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:06 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:07.022597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:07.023201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:07.030563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:07.031042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:07.031479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:07.032175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:07.032621 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:07.033045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:07.066561 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:07.067274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:07.073852 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:07.074446 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:07.075836 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:07.077477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:07.078527 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:07.079423 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:07.098726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:07.106875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-666eb0b0-e72c-4343-9b93-6bbff64d82da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1136 microversion: 2.1 time: 0.088258 Oct 04 05:48:07.110801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 389/800] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:07 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:07.169462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:07.172256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:07.176541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:07.177032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:07.177469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:07.178250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:07.178709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:07.179129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:07.214027 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:07.222401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d9721024-c653-408f-b76f-01b94733d196 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1735 microversion: 2.1 time: 0.160023 Oct 04 05:48:07.222994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 412/801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:07 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:07.239687 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:07.247213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e9d593a3-007c-49bd-ba9e-d519b33f5508 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1294 microversion: 2.1 time: 0.082247 Oct 04 05:48:07.247762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 390/802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:07 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:08.129718 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:08.130321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:08.136661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.137145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.137582 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.138300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.138759 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.139375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.215922 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:08.223994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d9972ae6-d18a-491c-95bd-7b8f6cf58a2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1136 microversion: 2.1 time: 0.098305 Oct 04 05:48:08.224554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 413/803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:08 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1136 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:08.244626 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:08.245225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:08.251650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.252125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.252552 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.253227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.253668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.254081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.269873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:08.270678 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:08.276449 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.276924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.277344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.278028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.278493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.278909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.297431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:08.340496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:08.349105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e511263f-5940-46d5-89f0-b75c5d6457a9 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1294 microversion: 2.1 time: 0.083115 Oct 04 05:48:08.349683 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 414/804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:08 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:08.387286 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:08.396015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8a29c589-c5ad-4ce0-a3c8-a28e93ea54c2 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1715 microversion: 2.1 time: 0.155138 Oct 04 05:48:08.396584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 391/805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:08 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:08.505426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:08.505920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:08.512196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.512732 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.513172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.514449 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.514908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.515334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.597957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] HTTP exception thrown: Cannot 'detach_volume' instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 while it is in vm_state rescued Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Request method failure captured: Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments/bb672ec1-c7da-4f11-ad8b-555ede98fe1b HTTP/1.1 Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8gw41q9dwS_KnobwoDRNzhRJFIsISD2v3S5ulTMXUx99p89WzzUPyTq164ojGmXyTNImVDrM33A2S1oGuxmLS6UEjkrhDk23xPZf130OIwZNI6AUJFHJHKumSPZmuNeiOmQGJnVC4jSFiG1TWA_V9v-Mk5QSoUeuaPLSaNwHKT78_Q Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:48:08.601197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_689c4759cb5943b79f2637a8e29e230e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}] Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c1b48a973c20470a9af23c77e3da5b72 Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:48:08.602702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Cannot 'detach_volume' instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 while it is in vm_state rescued Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'server_id': '6ef1eaae-b386-4ce1-9d08-63972bda8851', 'id': 'bb672ec1-c7da-4f11-ad8b-555ede98fe1b'} Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:48:08.603434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 while it is in vm_state rescued Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 while it is in vm_state rescued Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:08.604875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Returning 409 to user: Cannot 'detach_volume' instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 while it is in vm_state rescued {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:48:08.606013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-493d25e8-f2fb-4d3e-9ed9-8194f9884252 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments/bb672ec1-c7da-4f11-ad8b-555ede98fe1b" status: 409 len: 152 microversion: 2.1 time: 0.099835 Oct 04 05:48:08.606013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 415/806] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:48:08 2022] DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments/bb672ec1-c7da-4f11-ad8b-555ede98fe1b => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 05:48:08.610386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:08.610920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:08.617336 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.618067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.618795 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.619670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.620278 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.621261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.808563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3fb6c93b-f4b1-4aa5-874a-312024df5b30 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "POST /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/action" status: 202 len: 0 microversion: 2.1 time: 0.202007 Oct 04 05:48:08.810498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 392/807] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:48:08 2022] POST /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:48:08.818930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:08.819857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:08.829522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.833577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.833577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.833577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:08.833577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:08.834003 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:08.994164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:09.003558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4c76387e-3ef4-4d2d-81c9-36e244d64b58 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1723 microversion: 2.1 time: 0.189200 Oct 04 05:48:09.004390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 416/808] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:08 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:09.247604 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:09.248944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:09.256383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:09.256870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:09.257308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:09.258033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:09.258514 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:09.258937 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:09.337621 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:09.345519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f17924ba-55a9-408e-8014-61569c75283f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1192 microversion: 2.1 time: 0.102320 Oct 04 05:48:09.346094 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 393/809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:09 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:09.371569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:09.372162 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:09.379372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:09.379854 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:09.380484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:09.381338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:09.381804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:09.382247 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:09.444126 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:09.452774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6c51ba45-757a-41fb-b69a-577cabef5edb tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1300 microversion: 2.1 time: 0.085054 Oct 04 05:48:09.453350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 417/810] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:09 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:10.027496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:10.028090 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:10.035357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:10.035834 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:10.036264 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:10.036958 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:10.037404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:10.037829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:10.368319 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:10.368929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:10.376792 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:10.377436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:10.377698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:10.378637 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:10.379098 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:10.379526 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:10.379892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:10.391159 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-caea9c98-22c4-4e0f-b4c9-2e3c89b5ffdb tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1723 microversion: 2.1 time: 0.367479 Oct 04 05:48:10.391941 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 394/811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:10 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:10.443301 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:10.451931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d0194db7-cdd0-4c54-b9b1-8c1f22f14d18 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1210 microversion: 2.1 time: 0.086944 Oct 04 05:48:10.452499 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 418/812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:10 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:10.477856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:10.480831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:10.484606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:10.485101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:10.485526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:10.486241 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:10.486779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:10.487195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:10.778042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:10.785761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ea0d46da-6000-43c5-bd45-b178e7fa9a4a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.311712 Oct 04 05:48:10.786443 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 395/813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:10 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:11.414473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:11.415239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:11.421909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.422418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.422851 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.423601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.424058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.424486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.476656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:11.477908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:11.486536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.487329 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.487914 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.490983 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.492234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.492893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.582861 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:11.592698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a892ace4-2917-4113-bfe2-e2aca7595952 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1723 microversion: 2.1 time: 0.181495 Oct 04 05:48:11.593748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 419/814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:11 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:11.679680 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-8f18a1b4-aa4c-4a6d-aa81-69548c1357fd req-c8653861-8c2b-4347-adfe-825f40e018c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a236b9-6696-4cc5-9cd3-c0784a5f9df4", "tag": "61425b0d-a5a9-464e-a54a-4afd7be1d75c"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:11.690165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-8f18a1b4-aa4c-4a6d-aa81-69548c1357fd req-c8653861-8c2b-4347-adfe-825f40e018c1 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.690662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-8f18a1b4-aa4c-4a6d-aa81-69548c1357fd req-c8653861-8c2b-4347-adfe-825f40e018c1 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.691147 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-8f18a1b4-aa4c-4a6d-aa81-69548c1357fd req-c8653861-8c2b-4347-adfe-825f40e018c1 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.703836 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-8f18a1b4-aa4c-4a6d-aa81-69548c1357fd req-c8653861-8c2b-4347-adfe-825f40e018c1 service nova] Creating event network-changed:61425b0d-a5a9-464e-a54a-4afd7be1d75c for instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 on hv-cinder-84914 Oct 04 05:48:11.708947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-8f18a1b4-aa4c-4a6d-aa81-69548c1357fd req-c8653861-8c2b-4347-adfe-825f40e018c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097161 Oct 04 05:48:11.709546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 420/815] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:48:11.710297 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:11.718207 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0c84c244-d4fb-4bdc-b7ce-2c1b5d8097ac tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1278 microversion: 2.1 time: 0.246146 Oct 04 05:48:11.718807 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 396/816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:11 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:11.811128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:11.811824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:11.818267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.818740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.819171 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.819889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:11.820333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:11.820750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:11.949352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:11.957838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0dd77940-7e7f-4f98-b77b-4f8cf2f8608c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.152261 Oct 04 05:48:11.958424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 421/817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:11 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:12.624777 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:12.625281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:12.632057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:12.633869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:12.633869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:12.633869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:12.634337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:12.634794 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:12.742315 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:12.742907 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:12.749391 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:12.749864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:12.750355 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:12.751041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:12.751486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:12.751904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:12.875709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:12.883929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:12.884431 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-87afc59a-8487-4f24-9107-f6a01976e2cf tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1723 microversion: 2.1 time: 0.264004 Oct 04 05:48:12.892641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3df26092-d53c-45e3-aa4e-ab3c72e59080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1278 microversion: 2.1 time: 0.154283 Oct 04 05:48:12.893633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 422/818] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:12 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:12.908818 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 397/819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:12 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:12.980658 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:12.981259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:12.987173 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:12.987657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:12.988075 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:12.993008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:12.993008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:12.993008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:13.127187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:13.136189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f2a2158a-950f-4817-9c4b-5b43cf8b961c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.159363 Oct 04 05:48:13.136857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 423/820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:12 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:13.723459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-b673f232-5cec-4908-aac3-5fe7cd475f9f req-563dc891-1f5d-4347-b03f-305ae5ae710c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "517a5b7f-76e0-4888-8e50-c6972ee30554", "tag": "3846f25e-2d58-45ca-827a-81e04bfd4146"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:13.733823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b673f232-5cec-4908-aac3-5fe7cd475f9f req-563dc891-1f5d-4347-b03f-305ae5ae710c service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:13.734325 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b673f232-5cec-4908-aac3-5fe7cd475f9f req-563dc891-1f5d-4347-b03f-305ae5ae710c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:13.734749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b673f232-5cec-4908-aac3-5fe7cd475f9f req-563dc891-1f5d-4347-b03f-305ae5ae710c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:13.745497 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-b673f232-5cec-4908-aac3-5fe7cd475f9f req-563dc891-1f5d-4347-b03f-305ae5ae710c service nova] Creating event network-changed:3846f25e-2d58-45ca-827a-81e04bfd4146 for instance 517a5b7f-76e0-4888-8e50-c6972ee30554 on hv-cinder-84914 Oct 04 05:48:13.751130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-b673f232-5cec-4908-aac3-5fe7cd475f9f req-563dc891-1f5d-4347-b03f-305ae5ae710c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031307 Oct 04 05:48:13.751970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 398/821] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:13.916235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:13.916839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:13.918808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:13.919526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:13.925951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:13.925951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:13.925951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:13.925951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:13.926575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:13.926678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:13.926783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:13.926878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:13.927245 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:13.927944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:13.928407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:13.928815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:14.061930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:14.070053 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-82607fc7-ad99-4c9f-a5ed-b438388e4cae tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.157754 Oct 04 05:48:14.070648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 424/822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:13 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:14.159977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:14.160587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:14.162590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:14.167414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:14.167901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:14.172207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:14.172207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:14.172207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:14.172207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:14.209855 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:14.219473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3720a18f-33e3-4cb7-b5ce-17579360b681 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1729 microversion: 2.1 time: 0.304718 Oct 04 05:48:14.220512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 399/823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:13 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:14.243450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:14.244492 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:14.252164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:14.252654 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:14.253088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:14.254002 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:14.254473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:14.255094 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:14.315363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:14.323588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bdfee6c9-c73d-4a03-8913-923fb303d62f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.167470 Oct 04 05:48:14.324168 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 425/824] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:14 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:14.393980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-58014f55-613d-46d5-9187-7339632348a9 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155239 Oct 04 05:48:14.394612 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 400/825] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:48:14 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:48:15.093056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:15.093666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:15.100661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.101152 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.101591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.102330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.102866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.103300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.344015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:15.344812 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=10 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:15.348839 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:15.349431 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:15.355454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.359960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.359960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.359960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.359960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.360433 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.492410 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:15.500199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fe2fd3e1-ada1-4834-96b7-611f837344ed tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.157676 Oct 04 05:48:15.500771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 401/826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:15 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:15.543073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:15.551884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1ace4c21-2e10-4fc1-a731-db0e7c4297d5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.462767 Oct 04 05:48:15.552471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 426/827] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:15 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:15.662984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-3b40b36e-822f-46fd-9a7c-ac0c363a03d7 req-8256a032-6d4e-401b-bc5d-3de13179ee93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef1eaae-b386-4ce1-9d08-63972bda8851", "tag": "6aff3573-db21-4dc2-80d8-968b7594ff8b"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:15.673161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-3b40b36e-822f-46fd-9a7c-ac0c363a03d7 req-8256a032-6d4e-401b-bc5d-3de13179ee93 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.673721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-3b40b36e-822f-46fd-9a7c-ac0c363a03d7 req-8256a032-6d4e-401b-bc5d-3de13179ee93 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.674272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-3b40b36e-822f-46fd-9a7c-ac0c363a03d7 req-8256a032-6d4e-401b-bc5d-3de13179ee93 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.685173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-3b40b36e-822f-46fd-9a7c-ac0c363a03d7 req-8256a032-6d4e-401b-bc5d-3de13179ee93 service nova] Creating event network-changed:6aff3573-db21-4dc2-80d8-968b7594ff8b for instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 on hv-cinder-84914 Oct 04 05:48:15.690540 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-3b40b36e-822f-46fd-9a7c-ac0c363a03d7 req-8256a032-6d4e-401b-bc5d-3de13179ee93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093986 Oct 04 05:48:15.690930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 402/828] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:15.771313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1689999304"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:15.771847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:15.777827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.778350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.793583 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.793583 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:15.793583 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:15.793583 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:15.919206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.network.security_group_api [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Removing security group e2beedac-f946-4c31-af85-7e6c924292ed from port 488f01ec-9da2-43ab-bec8-f65c29213231 Oct 04 05:48:15.998165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=12 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:16.332825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ec879585-e91b-451f-a574-5e3dcb1ff72e tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/action" status: 202 len: 0 microversion: 2.1 time: 0.565564 Oct 04 05:48:16.338226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 427/829] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:48:15 2022] POST /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:48:16.524401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:16.525717 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:16.532391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:16.535935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:16.535935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:16.535935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:16.535935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:16.536340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:16.576118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:16.577538 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:16.583988 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:16.584575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:16.585260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:16.586038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:16.586711 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:16.587366 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:16.899273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:16.903182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:16.909247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5be16dc8-aaab-4e44-96ca-7e453c2d62a6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.389444 Oct 04 05:48:16.909874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 403/830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:16 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:16.920414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:16.934225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7d8e705d-2c6c-480f-8064-d27f5bc5ae4c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.362734 Oct 04 05:48:16.935039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 428/831] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:16 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:17.691075 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:17.691681 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:17.699437 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:17.699929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:17.701175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:17.701175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:17.701548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:17.702115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:17.705662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef1eaae-b386-4ce1-9d08-63972bda8851", "tag": "6aff3573-db21-4dc2-80d8-968b7594ff8b"}, {"name": "network-changed", "server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}, {"name": "network-changed", "server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:17.718891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:17.719366 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:17.727275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:17.735537 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Creating event network-changed:6aff3573-db21-4dc2-80d8-968b7594ff8b for instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 on hv-cinder-84914 Oct 04 05:48:17.736341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Creating event network-changed:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:48:17.737009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] Creating event network-changed:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:48:17.745465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-dbcc68d7-e270-4fbf-b878-af3dc9cadae9 req-224277a6-0c6a-4d5c-836b-c28df54a2c14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.043936 Oct 04 05:48:17.750260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 429/832] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:17.789591 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lazy-loading 'services' on Instance uuid 864bd56b-7557-413d-9480-d225873e42a5 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:48:17.933454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:17.934164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:17.941269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:17.941744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:17.942423 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:17.943099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:17.943714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:17.944132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:18.021607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-611f842d-8f98-4562-ba8c-fb2533d15192 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments/f086516d-1633-49c7-8a71-a4eb035e9e39" status: 202 len: 0 microversion: 2.1 time: 0.334610 Oct 04 05:48:18.022910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 404/833] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:48:17 2022] DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments/f086516d-1633-49c7-8a71-a4eb035e9e39 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:48:18.028567 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:18.029902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:18.036507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:18.037219 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:18.038497 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:18.039381 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:18.040009 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:18.040597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:18.108187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:18.116216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0c3d0c76-09cc-4598-b31a-a6296a729579 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.186821 Oct 04 05:48:18.117517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 430/834] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:17 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:18.123911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:18.126401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:18.136358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:18.136957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:18.137497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:18.138583 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:18.139129 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:18.139652 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:18.174431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f283c378-02d4-487a-a70f-6a829ca0a83a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055241 Oct 04 05:48:18.175099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 431/835] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:18 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:18.281179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:18.289193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7e245f55-bd77-4250-997c-7d44395ae3e4 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.264948 Oct 04 05:48:18.289760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 405/836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:18 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:19.022059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-b57fb3dc-8f91-44e8-988a-db1f63e4be04 req-6679beef-3113-437b-95b1-84c63cf9c47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a236b9-6696-4cc5-9cd3-c0784a5f9df4", "name": "network-vif-plugged", "status": "completed", "tag": "61425b0d-a5a9-464e-a54a-4afd7be1d75c"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:19.033236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-b57fb3dc-8f91-44e8-988a-db1f63e4be04 req-6679beef-3113-437b-95b1-84c63cf9c47b service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.033937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-b57fb3dc-8f91-44e8-988a-db1f63e4be04 req-6679beef-3113-437b-95b1-84c63cf9c47b service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.034470 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-b57fb3dc-8f91-44e8-988a-db1f63e4be04 req-6679beef-3113-437b-95b1-84c63cf9c47b service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.046438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-b57fb3dc-8f91-44e8-988a-db1f63e4be04 req-6679beef-3113-437b-95b1-84c63cf9c47b service nova] Creating event network-vif-plugged:61425b0d-a5a9-464e-a54a-4afd7be1d75c for instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 on hv-cinder-84914 Oct 04 05:48:19.051493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-b57fb3dc-8f91-44e8-988a-db1f63e4be04 req-6679beef-3113-437b-95b1-84c63cf9c47b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Oct 04 05:48:19.052084 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 432/837] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:19.142343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:19.153319 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:19.166250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.166250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.166250 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.167850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.168483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.168938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.188212 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:19.190902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:19.197902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.198652 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.199089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.199779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.200390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.200846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.218431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=100 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:19.231268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-da124039-8112-41ae-a3cd-ca85b05f173a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Oct 04 05:48:19.231821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 433/838] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:19 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:48:19.313022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:19.313669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:19.319930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.320411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.320844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.321642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:19.322088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:19.322544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:19.366874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:19.375343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7e6cd20f-327e-468f-9aaf-5fb0247ddc9b tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.238656 Oct 04 05:48:19.376343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 406/839] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:19 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:19.472657 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:19.480418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-eb51f74c-cb37-4e02-919d-17fa95caf7a5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.171856 Oct 04 05:48:19.486161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 434/840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:19 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:20.243978 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:20.246221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:20.252740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.253217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.253656 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.254399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.254865 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.255281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.283612 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-54217225-1308-4382-a778-c01a8d905bb7 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043648 Oct 04 05:48:20.284170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 407/841] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:20 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:48:20.295444 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:20.295940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:20.302380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.302861 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.303299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.303985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.304437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.304863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.377355 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] HTTP exception thrown: Instance 864bd56b-7557-413d-9480-d225873e42a5 is not attached to volume f086516d-1633-49c7-8a71-a4eb035e9e39 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Request method failure captured: Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments/f086516d-1633-49c7-8a71-a4eb035e9e39 HTTP/1.1 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8hjsvpximWTVZUzGAQO5DPvFWA15U1vFwwpAARtOS4iRXe8M_UpVnFDGEnfu3W3X4SPsyewfhMIjYhSyr01WpYbTSKEGOoNIiz6F_qtEei7_QDh85hUkLCpA8wKkwg7JDWD8R13hLXIrXkK16UBQSqDgTSJ2P7p3AfQlXSUSQcYknQ Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: c237fdd93f3e47dea64bd0143f09b819 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-TestMinimumBasicScenario-309325434 Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:48:20.379782 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c237fdd93f3e47dea64bd0143f09b819", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c237fdd93f3e47dea64bd0143f09b819"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c237fdd93f3e47dea64bd0143f09b819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c237fdd93f3e47dea64bd0143f09b819"}]}] Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-TestMinimumBasicScenario-309325434 Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: c237fdd93f3e47dea64bd0143f09b819 Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309325434 Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-TestMinimumBasicScenario-309325434-project Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: db24ed507ded40fe828c84bc138f893b Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-TestMinimumBasicScenario-309325434-project Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:48:20.381418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 864bd56b-7557-413d-9480-d225873e42a5 is not attached to volume f086516d-1633-49c7-8a71-a4eb035e9e39 Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'server_id': '864bd56b-7557-413d-9480-d225873e42a5', 'id': 'f086516d-1633-49c7-8a71-a4eb035e9e39'} Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f086516d-1633-49c7-8a71-a4eb035e9e39. Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:48:20.382317 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864bd56b-7557-413d-9480-d225873e42a5 is not attached to volume f086516d-1633-49c7-8a71-a4eb035e9e39 Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864bd56b-7557-413d-9480-d225873e42a5 is not attached to volume f086516d-1633-49c7-8a71-a4eb035e9e39 Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:20.383783 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Returning 404 to user: Instance 864bd56b-7557-413d-9480-d225873e42a5 is not attached to volume f086516d-1633-49c7-8a71-a4eb035e9e39 {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:48:20.384879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5457c064-aa64-49aa-bb44-3be088539724 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments/f086516d-1633-49c7-8a71-a4eb035e9e39" status: 404 len: 154 microversion: 2.1 time: 0.090310 Oct 04 05:48:20.384879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 435/842] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:48:20 2022] DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5/os-volume_attachments/f086516d-1633-49c7-8a71-a4eb035e9e39 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:48:20.399608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:20.400218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:20.406759 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.407242 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.407679 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.408368 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.408820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.409244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.503122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:20.503646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:20.509718 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.510240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.510682 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.511379 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:20.511949 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:20.512376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:20.580009 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:20.592446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-931c7a97-aaad-4ede-9e83-2e4007844f0d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1368 microversion: 2.1 time: 0.193775 Oct 04 05:48:20.592446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 408/843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:20 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:20.655991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:20.663911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c43e5e8d-7235-4429-9deb-5ba901b1ef49 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.164857 Oct 04 05:48:20.664485 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 436/844] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:20 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:21.614077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:21.616897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:21.621087 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.621566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.621989 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.622694 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.623135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.623551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.686308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:21.686829 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:21.693489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.693964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.694445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.695139 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.695585 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.696002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.721984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:48:21.756815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:21.765265 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1a6249bf-8e67-4501-837f-9df23c95b054 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1558 microversion: 2.1 time: 0.155024 Oct 04 05:48:21.765822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 409/845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:21 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:21.770331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:21.770930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:21.776573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.777060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.777512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.778237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.778698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.779916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.907866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:21.915608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-62d89198-a274-4953-b7f8-fc30f921c8ab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.148781 Oct 04 05:48:21.916379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 410/846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:21 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:21.920689 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:21.921176 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:21.926810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.927306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.929554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.929554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:21.929554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:21.929554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:21.991877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e4c66860-7e1a-4a53-98dd-67a9221faea5 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 204 len: 0 microversion: 2.1 time: 0.309207 Oct 04 05:48:21.992482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 437/847] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:48:21 2022] DELETE /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 05:48:22.001612 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:22.004238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:22.008521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:22.008757 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-04d76060-1dd0-41df-a64d-a385d8ee124e tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091522 Oct 04 05:48:22.008999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:22.009359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 411/848] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 4 05:48:21 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:22.009471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:22.010322 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:22.010784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:22.011220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:22.139892 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:22.147725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6ea527fc-903b-47d4-a7d8-809a22a361f9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1553 microversion: 2.1 time: 0.150791 Oct 04 05:48:22.148287 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 438/849] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:21 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:22.939712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:22.940326 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:22.946387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:22.946869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:22.947306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:22.947997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:22.948455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:22.948907 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:23.172112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:23.172723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:23.179284 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:23.179772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:23.180211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:23.181040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:23.181364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:23.181800 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:23.183748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:23.193360 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-49ffaaa6-560d-4cc8-a952-d0f01e88ce42 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.258225 Oct 04 05:48:23.194214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 412/850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:22 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:23.314115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:23.322034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6fad6f3a-60da-4762-8024-9c3ecfd6367c tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1553 microversion: 2.1 time: 0.154270 Oct 04 05:48:23.322648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 439/851] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:23 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:23.385284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-b0ca7304-e8e0-4df7-a0d4-c8da9e361868 req-36d5ec0e-a178-4a38-bc78-07f44b165136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a236b9-6696-4cc5-9cd3-c0784a5f9df4", "tag": "61425b0d-a5a9-464e-a54a-4afd7be1d75c"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:23.395562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b0ca7304-e8e0-4df7-a0d4-c8da9e361868 req-36d5ec0e-a178-4a38-bc78-07f44b165136 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:23.396038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b0ca7304-e8e0-4df7-a0d4-c8da9e361868 req-36d5ec0e-a178-4a38-bc78-07f44b165136 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:23.396474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b0ca7304-e8e0-4df7-a0d4-c8da9e361868 req-36d5ec0e-a178-4a38-bc78-07f44b165136 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:23.408330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-b0ca7304-e8e0-4df7-a0d4-c8da9e361868 req-36d5ec0e-a178-4a38-bc78-07f44b165136 service nova] Creating event network-changed:61425b0d-a5a9-464e-a54a-4afd7be1d75c for instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 on hv-cinder-84914 Oct 04 05:48:23.413575 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-b0ca7304-e8e0-4df7-a0d4-c8da9e361868 req-36d5ec0e-a178-4a38-bc78-07f44b165136 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031982 Oct 04 05:48:23.414225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 413/852] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:24.216277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:24.217628 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:24.224536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:24.225021 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:24.225459 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:24.226187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:24.226645 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:24.227075 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:24.347821 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:24.349201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:24.355964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:24.356705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:24.357870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:24.362960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:24.362960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:24.362960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:24.399282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:24.408191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e1cec293-6b11-4669-b404-aef9fafde74a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.195817 Oct 04 05:48:24.408964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 440/853] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:24 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:24.496331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:24.504390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9637c2a9-71dc-485c-9b84-bb355787666a tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1553 microversion: 2.1 time: 0.161537 Oct 04 05:48:24.504959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 414/854] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:24 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:25.431773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:25.432985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:25.440821 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:25.441299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:25.441729 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:25.442438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:25.443068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:25.443855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:25.528666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:25.529404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:25.537247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:25.537858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:25.538599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:25.539451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:25.539970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:25.540632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:25.593222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:25.601644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-865391f8-415a-4147-b5e8-317bff0e930d tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.173799 Oct 04 05:48:25.602324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 441/855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:25 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:25.660729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:25.669420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ec3ea274-56a8-4e51-84fc-bd8d8b8206c3 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1511 microversion: 2.1 time: 0.144994 Oct 04 05:48:25.671004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 415/856] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:25 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:25.695049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-57594f33-be1a-4785-ad18-6dcc3ad27ace req-dd4548a5-198d-4072-8e03-3d594853b8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864bd56b-7557-413d-9480-d225873e42a5", "name": "network-vif-deleted", "tag": "488f01ec-9da2-43ab-bec8-f65c29213231"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:25.705494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-57594f33-be1a-4785-ad18-6dcc3ad27ace req-dd4548a5-198d-4072-8e03-3d594853b8de service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:25.706259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-57594f33-be1a-4785-ad18-6dcc3ad27ace req-dd4548a5-198d-4072-8e03-3d594853b8de service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:25.712017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-57594f33-be1a-4785-ad18-6dcc3ad27ace req-dd4548a5-198d-4072-8e03-3d594853b8de service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:25.718686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-57594f33-be1a-4785-ad18-6dcc3ad27ace req-dd4548a5-198d-4072-8e03-3d594853b8de service nova] Creating event network-vif-deleted:488f01ec-9da2-43ab-bec8-f65c29213231 for instance 864bd56b-7557-413d-9480-d225873e42a5 on hv-cinder-84914 Oct 04 05:48:25.723648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-57594f33-be1a-4785-ad18-6dcc3ad27ace req-dd4548a5-198d-4072-8e03-3d594853b8de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032931 Oct 04 05:48:25.724243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 442/857] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:26.626507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:26.627116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:26.633597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:26.634076 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:26.634547 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:26.635237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:26.635686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:26.636119 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:26.705831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:26.705831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:26.705831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:26.705831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:26.706714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:26.706714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:26.706714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:26.706714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:26.735658 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:26.736135 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:26.736587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:26.737030 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lazy-loading 'fault' on Instance uuid 864bd56b-7557-413d-9480-d225873e42a5 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:48:26.778522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:26.779629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db24ed507ded40fe828c84bc138f893b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c237fdd93f3e47dea64bd0143f09b819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:26.786873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-93ac420c-0b1d-4c42-938a-e2fe2e12e6e1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.164721 Oct 04 05:48:26.788299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fe9452b0-7efb-4b8b-9cdf-5fcf7e58e3b9 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 200 len: 1347 microversion: 2.1 time: 0.098047 Oct 04 05:48:26.798358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 443/858] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:26 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:26.798530 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 416/859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:26 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:27.092323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-beac047d-5f63-4544-9353-583a06d0a162 req-a5144296-193f-47bb-8c4a-64e9efb31818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517a5b7f-76e0-4888-8e50-c6972ee30554", "name": "network-vif-plugged", "status": "completed", "tag": "3846f25e-2d58-45ca-827a-81e04bfd4146"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:27.101541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-beac047d-5f63-4544-9353-583a06d0a162 req-a5144296-193f-47bb-8c4a-64e9efb31818 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:27.102006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-beac047d-5f63-4544-9353-583a06d0a162 req-a5144296-193f-47bb-8c4a-64e9efb31818 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:27.102461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-beac047d-5f63-4544-9353-583a06d0a162 req-a5144296-193f-47bb-8c4a-64e9efb31818 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:27.113713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-beac047d-5f63-4544-9353-583a06d0a162 req-a5144296-193f-47bb-8c4a-64e9efb31818 service nova] Creating event network-vif-plugged:3846f25e-2d58-45ca-827a-81e04bfd4146 for instance 517a5b7f-76e0-4888-8e50-c6972ee30554 on hv-cinder-84914 Oct 04 05:48:27.119328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-beac047d-5f63-4544-9353-583a06d0a162 req-a5144296-193f-47bb-8c4a-64e9efb31818 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030889 Oct 04 05:48:27.119898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 444/860] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:27.809815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:27.810376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:27.813306 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:27.814274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] [instance: 864bd56b-7557-413d-9480-d225873e42a5] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:27.817281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:27.817765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:27.818234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:27.818927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:27.819380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:27.819809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:27.820915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:27.821393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:27.821834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:27.822550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:27.822999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:27.823431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:27.837132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] HTTP exception thrown: Instance 864bd56b-7557-413d-9480-d225873e42a5 could not be found. Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Request method failure captured: Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 HTTP/1.1 Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8hjsvpximWTVZUzGAQO5DPvFWA15U1vFwwpAARtOS4iRXe8M_UpVnFDGEnfu3W3X4SPsyewfhMIjYhSyr01WpYbTSKEGOoNIiz6F_qtEei7_QDh85hUkLCpA8wKkwg7JDWD8R13hLXIrXkK16UBQSqDgTSJ2P7p3AfQlXSUSQcYknQ Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: c237fdd93f3e47dea64bd0143f09b819 Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-TestMinimumBasicScenario-309325434 Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:48:27.838799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c237fdd93f3e47dea64bd0143f09b819", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c237fdd93f3e47dea64bd0143f09b819"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c237fdd93f3e47dea64bd0143f09b819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c237fdd93f3e47dea64bd0143f09b819"}]}] Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-TestMinimumBasicScenario-309325434 Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: c237fdd93f3e47dea64bd0143f09b819 Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309325434 Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-TestMinimumBasicScenario-309325434-project Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: db24ed507ded40fe828c84bc138f893b Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-TestMinimumBasicScenario-309325434-project Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 864bd56b-7557-413d-9480-d225873e42a5 could not be found. Oct 04 05:48:27.840239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '864bd56b-7557-413d-9480-d225873e42a5'} Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864bd56b-7557-413d-9480-d225873e42a5 could not be found. Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:48:27.840984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864bd56b-7557-413d-9480-d225873e42a5 could not be found. Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864bd56b-7557-413d-9480-d225873e42a5 could not be found. Oct 04 05:48:27.842843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:48:27.843982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Returning 404 to user: Instance 864bd56b-7557-413d-9480-d225873e42a5 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:48:27.843982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f448079f-3ae0-4acc-b56a-98fe09a75b77 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5" status: 404 len: 111 microversion: 2.1 time: 0.031304 Oct 04 05:48:27.843982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 445/861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:27 2022] GET /compute/v2.1/servers/864bd56b-7557-413d-9480-d225873e42a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:48:27.849217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9376e25c-2152-4700-a8da-4ea327ffd569 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] Calling method '.version_select at 0x7f04865a1310>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:27.925748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9376e25c-2152-4700-a8da-4ea327ffd569 tempest-TestMinimumBasicScenario-309325434 tempest-TestMinimumBasicScenario-309325434-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-296923354" status: 202 len: 0 microversion: 2.1 time: 0.079983 Oct 04 05:48:27.926454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 446/862] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 4 05:48:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-296923354 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:48:27.954395 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:27.962102 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-18f20390-a93e-4b12-a93b-eba3295ae2da tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.156261 Oct 04 05:48:27.962912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 417/863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:27 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:28.990921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:28.991564 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:29.000614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:29.001102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:29.001544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:29.002277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:29.002735 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:29.003170 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:29.143363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:29.152034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fda2526b-f4db-4482-8737-3a223a1f2fd7 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1266 microversion: 2.1 time: 0.164727 Oct 04 05:48:29.152034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 447/864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:28 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:30.174261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:30.174838 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:30.181189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:30.181653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:30.182076 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:30.182775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:30.183215 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:30.183630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:30.339939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:30.348871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bfd80c69-f11a-42c0-a654-cb220e7baa70 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1452 microversion: 2.1 time: 0.179014 Oct 04 05:48:30.349375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 418/865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:30 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:30.371261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:30.372012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:30.375269 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:30.380416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:30.380994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:30.381528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:30.382481 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:30.382933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:30.383362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:30.756212 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:30.763977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-60d1eb9e-5aae-4b56-8a22-569282c4c2ba tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1452 microversion: 2.1 time: 0.396590 Oct 04 05:48:30.764550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 448/866] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:30 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1452 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:48:33.079449 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-41781602-e510-4d0e-949c-acd980f88d82 req-0883e44a-090f-41ae-934f-476b58faebdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "517a5b7f-76e0-4888-8e50-c6972ee30554", "tag": "3846f25e-2d58-45ca-827a-81e04bfd4146"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:33.110732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-41781602-e510-4d0e-949c-acd980f88d82 req-0883e44a-090f-41ae-934f-476b58faebdc service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:33.111510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-41781602-e510-4d0e-949c-acd980f88d82 req-0883e44a-090f-41ae-934f-476b58faebdc service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:33.112104 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-41781602-e510-4d0e-949c-acd980f88d82 req-0883e44a-090f-41ae-934f-476b58faebdc service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:33.124447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-41781602-e510-4d0e-949c-acd980f88d82 req-0883e44a-090f-41ae-934f-476b58faebdc service nova] Creating event network-changed:3846f25e-2d58-45ca-827a-81e04bfd4146 for instance 517a5b7f-76e0-4888-8e50-c6972ee30554 on hv-cinder-84914 Oct 04 05:48:33.130562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-41781602-e510-4d0e-949c-acd980f88d82 req-0883e44a-090f-41ae-934f-476b58faebdc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054810 Oct 04 05:48:33.131349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 419/867] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:35.815195 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:35.816001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:35.823278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:35.823902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:35.824416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:35.825197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:35.825899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:35.826707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:35.852208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b076831a-93e3-441d-bb6d-00203da6733b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/ips" status: 200 len: 150 microversion: 2.20 time: 0.150162 Oct 04 05:48:35.852888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 449/868] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Oct 4 05:48:35 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/ips => generated 150 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 05:48:38.685285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:38.685938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:38.688862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=65 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:38.694534 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:38.695021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:38.695450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:38.696158 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:38.696601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:38.697023 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:38.723772 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'flavor' on Instance uuid ac56e7ba-43ea-4595-8551-352767e8e8fe {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:48:38.812969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:39.163647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e5a69767-14b7-40d1-ba40-953267c0f154 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/action" status: 202 len: 0 microversion: 2.20 time: 0.482800 Oct 04 05:48:39.164235 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 420/869] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 05:48:38 2022] POST /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:48:39.172608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:39.173215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:39.179733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:39.180217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:39.180656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:39.181349 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:39.181801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:39.182512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:39.314463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:39.322539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:39.323968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:39.325106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e6f9e035-9983-439b-bb93-161507cafc1e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.156435 Oct 04 05:48:39.326318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 450/870] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:39 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:40.351971 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:40.352663 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:40.358938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:40.359419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:40.359855 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:40.360542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:40.360993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:40.361420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:40.492762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:40.500866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:40.502363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:40.503525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5b7746de-923f-4904-b3f8-2fcd474e6cb1 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.156328 Oct 04 05:48:40.504088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 421/871] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:40 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:41.527952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:41.529127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:41.535675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:41.536156 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:41.536588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:41.537270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:41.537717 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:41.538166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:41.556513 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:48:41.664935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:41.673388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:41.674859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:41.676035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ed5bbe17-b8d6-4f58-81fc-4d34c2e13116 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.152019 Oct 04 05:48:41.676588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 451/872] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:41 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:42.701333 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:42.703265 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:42.708509 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:42.708980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:42.709409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:42.710082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:42.710652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:42.711069 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:42.987580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:42.995585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:42.997016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:42.998223 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b8285ba7-a6f1-4948-828e-f33946a802ca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.300809 Oct 04 05:48:42.998774 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 422/873] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:42 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:44.023478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:44.024113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:44.030749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:44.031230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:44.031666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:44.032358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:44.032810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:44.033232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:44.157601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:44.165574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:44.167032 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:44.168198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bc45ca7f-80c6-4ea7-9a9b-438b519850d2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.148702 Oct 04 05:48:44.168756 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 452/874] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:44 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:45.194446 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:45.195038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:45.201441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:45.201909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:45.202378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:45.203057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:45.203496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:45.203912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:45.331337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:45.339272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:45.340701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:45.342372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5e66a764-a863-4c54-9647-ac3bfe08cfe8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.151270 Oct 04 05:48:45.342917 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 423/875] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:45 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:46.367138 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:46.367736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:46.374843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:46.375320 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:46.375755 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:46.376434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:46.376881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:46.377300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:46.507569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:46.515737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:46.517177 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:46.518367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1b9d44f1-7c93-405f-86bb-062c16da5885 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.155079 Oct 04 05:48:46.518930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 453/876] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:46 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:46.791155 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:46.791653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:46.798739 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:46.799225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:46.799655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:46.800435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:46.800879 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:46.801298 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:46.824342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e888d880-9f0e-4679-89af-68440c502ee7 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/ips" status: 200 len: 144 microversion: 2.1 time: 0.037355 Oct 04 05:48:46.824892 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 424/877] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:48:46 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:47.543252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:47.543904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:47.550465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:47.550991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:47.551428 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:47.552141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:47.552589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:47.553013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:47.681725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:47.690729 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:47.692178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:47.693341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7b4c14a3-4280-43b7-80f1-71280421cc8d tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.154050 Oct 04 05:48:47.693911 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 454/878] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:47 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:48.364228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9159bee4-6833-4d51-9288-b8256a669ee7"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:48.366710 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:48.373032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:48.373507 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:48.373936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:48.374637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:48.375082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:48.375620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:48.720500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:48.721104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:48.727851 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:48.728336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:48.729842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:48.729842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:48.730116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:48.730434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:48.864774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:48.873418 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:48.874859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:48.876040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-71fe7761-14bc-4f95-b639-9581091fa73c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.160960 Oct 04 05:48:48.876597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 455/879] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:48 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:49.054080 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a262614c-155f-4048-8e3e-960f18f5631a tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693576 Oct 04 05:48:49.054817 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 425/880] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:48:48 2022] POST /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:49.901252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:49.901855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:49.908859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:49.909333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:49.909763 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:49.910532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:49.910991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:49.911410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:50.039752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:50.048433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:50.050024 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:50.051097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-54ee3aad-b4e4-42d6-9178-41271ed30a0e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.153845 Oct 04 05:48:50.051642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 456/881] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:49 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:51.077462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:51.078178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:51.084458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:51.084934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:51.085369 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:51.086059 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:51.086541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:51.087023 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:51.214606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:51.223111 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:51.224548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:51.225857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9c7c57d4-55f4-49eb-82a1-9c300a15d51f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.153066 Oct 04 05:48:51.226444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 426/882] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:51 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:52.251404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:52.252012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:52.258610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:52.259100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:52.259553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:52.260248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:52.260699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:52.261123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:52.388474 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:52.397133 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:52.398613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:52.399805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9a3990fd-f8bc-4b86-80a3-4738a769fd09 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.152342 Oct 04 05:48:52.400367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 457/883] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:52 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:53.425890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:53.426522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:53.432945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:53.433426 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:53.433861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:53.434580 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:53.435032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:53.435458 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:53.567242 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:53.575273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:53.576811 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:53.578020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d456838d-61c3-4759-9cdb-029f5eeb04f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.156513 Oct 04 05:48:53.578606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 427/884] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:53 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:54.603651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:54.604180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:54.610629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:54.611106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:54.611539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:54.612220 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:54.612669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:54.613093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:54.740722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:54.748788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:54.750396 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:54.751548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ba7f0e4a-af76-49d7-a7f4-49b370ac87d7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.151888 Oct 04 05:48:54.752103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 458/885] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:54 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:55.776537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:55.777091 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:55.784150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:55.784631 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:55.785113 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:55.785828 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:55.786293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:55.786733 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:55.913206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:55.921356 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:55.923587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:55.924782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6090235f-df33-48b4-b626-4bacfb2234dc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.152436 Oct 04 05:48:55.925347 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 428/886] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:55 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:56.496718 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:56.500375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:56.504258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:56.504748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:56.505191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:56.505888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:56.506375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:56.506813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:56.599601 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'services' on Instance uuid 6ef1eaae-b386-4ce1-9d08-63972bda8851 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:48:56.836941 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b9b7a71b-d10c-4950-a330-3284b8d066df tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments/bb672ec1-c7da-4f11-ad8b-555ede98fe1b" status: 202 len: 0 microversion: 2.1 time: 0.343884 Oct 04 05:48:56.837518 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 459/887] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:48:56 2022] DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments/bb672ec1-c7da-4f11-ad8b-555ede98fe1b => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:48:56.846050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:56.851012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:56.855006 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:56.855487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:56.855924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:56.856623 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:56.857070 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:56.857505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:56.888017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c9ef449a-7725-4bcd-b261-b377af124145 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 Oct 04 05:48:56.888583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 429/888] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:56 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:56.954708 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:56.955401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:56.961689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:56.966308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:56.966308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:56.966308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:56.966308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:56.966691 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.094941 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:57.102901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:57.104345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:57.105490 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e83c6ab7-2a01-443d-924d-cd080ce70f39 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.155199 Oct 04 05:48:57.106046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 460/889] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:56 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:57.654389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:57.657225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:57.663197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:57.663724 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:57.664164 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.664853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:57.665303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:57.665725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.694828 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5caf6579-8c0a-409a-af9c-b78a6a7b94ce tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Oct 04 05:48:57.695385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 430/890] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:57 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:57.706839 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:57.707344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:57.713833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:57.714347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:57.714778 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.715459 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:57.716039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:57.716345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.895087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ee1b29fa-deb5-413c-8532-99ea604f6250 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/9159bee4-6833-4d51-9288-b8256a669ee7" status: 200 len: 194 microversion: 2.1 time: 0.192738 Oct 04 05:48:57.895968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 461/891] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 4 05:48:57 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/9159bee4-6833-4d51-9288-b8256a669ee7 => generated 194 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:48:57.901054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:57.903234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:57.910341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:57.910830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:57.911272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.911973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:57.912426 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:57.912856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:57.943743 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2a27b3c3-c17f-47f9-83b8-2a7e5651beae tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Oct 04 05:48:57.944334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 431/892] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:57 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:48:58.131246 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:58.131872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:58.137702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:58.138203 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:58.138635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:58.139308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:58.139749 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:58.140166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:58.273751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:58.281870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:58.283352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:58.284502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4088b4e2-057f-4085-ac59-60ce034cd30e tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.157145 Oct 04 05:48:58.285052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 462/893] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:58 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:48:58.956744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:58.958967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:58.965487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:58.965964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:58.966435 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:58.967126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:58.967579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:58.968004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:58.996541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ce52d742-231c-49ee-a6ab-71b89f5985ec tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044345 Oct 04 05:48:58.997089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 432/894] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:48:58 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:48:59.083447 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:59.083977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:59.090318 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.090802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.091239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.091929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.092376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.092800 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.117739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:48:59.310045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:59.310583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:59.316837 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.317313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.317746 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.318452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.318896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.319316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.398862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7ed1dbef-e25a-48e1-b9c1-4351669abc70 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 204 len: 0 microversion: 2.1 time: 0.318881 Oct 04 05:48:59.399452 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 463/895] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:48:59 2022] DELETE /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:48:59.407491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:48:59.408191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:59.414311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.414794 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.415242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.416562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.417156 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.448029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:59.457087 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:59.458551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:59.459760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c64f9cf6-24e6-4cc2-8226-be5d8d662d92 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.153769 Oct 04 05:48:59.460316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 433/896] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:48:59 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:48:59.546675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:48:59.554299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b652924-9ece-4585-8e3f-0a6f49b321a6"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:48:59.554475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3ef0c264-5fd1-43d2-8adb-f0584881fc44 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1689 microversion: 2.1 time: 0.150936 Oct 04 05:48:59.555014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 464/897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:48:59 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:48:59.556649 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:48:59.563086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.563506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.563941 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:48:59.564909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:48:59.565356 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:48:59.565783 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:00.484504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:00.485028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:00.487541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:00.492352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:00.492864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:00.493271 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:00.493952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:00.494433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:00.494859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:00.623712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:00.627094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:00.631944 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:00.633369 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:00.634533 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5f2853b1-a486-4163-93ab-8ff1a1f95109 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.153993 Oct 04 05:49:00.636226 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 465/898] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:00 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:00.639385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:00.639974 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:00.646059 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:00.646566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:00.646996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:00.647677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:00.648124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:00.648541 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:00.775771 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:00.783965 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9bf088ac-9ca2-483f-b936-73f75f3b2b67 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1689 microversion: 2.1 time: 0.147977 Oct 04 05:49:00.784522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 466/899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:00 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:01.659489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:01.660088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:01.666430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:01.666903 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:01.667331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:01.668008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:01.668450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:01.668868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:01.793485 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:01.801666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:01.803204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:01.804359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-925b40e7-3762-411f-9391-1b3903801d33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.148823 Oct 04 05:49:01.804905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 467/900] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:01 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:01.809320 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:01.809915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:01.816361 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:01.816833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:01.817264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:01.817950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:01.818426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:01.818866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:01.949967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:01.958563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b21c78fd-d78e-4090-bafb-23562bb3b1ac tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1689 microversion: 2.1 time: 0.152677 Oct 04 05:49:01.959128 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 468/901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:01 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:02.832102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:02.832739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:02.839097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:02.839753 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:02.840190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:02.840869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:02.841315 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:02.841731 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:02.974679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:02.982844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:02.984364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:02.985566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-43d1735f-831d-4e7a-8c4b-734dbdb8e65b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.157990 Oct 04 05:49:02.986155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 469/902] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:02 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:02.990466 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:02.991068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:02.996537 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:02.997012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:02.997449 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:03.001793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:03.001793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:03.001793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:03.129824 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:03.137715 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-39d7938b-d741-4f4f-aff3-92430a1113e6 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1689 microversion: 2.1 time: 0.150600 Oct 04 05:49:03.138344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 470/903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:02 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:03.236029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:03.819844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5b0b8c07-d0cf-490f-9157-08328e19271c tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "POST /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.269203 Oct 04 05:49:03.820420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 434/904] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:48:59 2022] POST /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 194 bytes in 4271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:04.010560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:04.011836 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:04.018382 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:04.018867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:04.019299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:04.019985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:04.020435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:04.020859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:04.152139 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:04.162208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:04.163234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:04.174043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:04.176067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:04.176551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:04.176986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:04.177277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:04.177684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:04.178130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:04.178569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a14d24a0-5e9b-4b21-8fdf-2f9f71bc1f64 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1742 microversion: 2.20 time: 0.171837 Oct 04 05:49:04.178690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:04.179138 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 471/905] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:04 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:04.187511 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-5e4c7189-0916-4207-ba86-9f017f2a3a0c req-424692d9-896c-4ecd-84f7-c3eac812caad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef1eaae-b386-4ce1-9d08-63972bda8851", "name": "network-vif-deleted", "tag": "6aff3573-db21-4dc2-80d8-968b7594ff8b"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:04.198695 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-5e4c7189-0916-4207-ba86-9f017f2a3a0c req-424692d9-896c-4ecd-84f7-c3eac812caad service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:04.199173 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-5e4c7189-0916-4207-ba86-9f017f2a3a0c req-424692d9-896c-4ecd-84f7-c3eac812caad service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:04.199603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-5e4c7189-0916-4207-ba86-9f017f2a3a0c req-424692d9-896c-4ecd-84f7-c3eac812caad service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:04.212014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-5e4c7189-0916-4207-ba86-9f017f2a3a0c req-424692d9-896c-4ecd-84f7-c3eac812caad service nova] Creating event network-vif-deleted:6aff3573-db21-4dc2-80d8-968b7594ff8b for instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 on hv-cinder-84914 Oct 04 05:49:04.219229 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-5e4c7189-0916-4207-ba86-9f017f2a3a0c req-424692d9-896c-4ecd-84f7-c3eac812caad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037916 Oct 04 05:49:04.220177 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 472/906] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:04.247608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:04.256981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f277946c-41b9-4ec8-b210-f6d3ef907b5d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1621 microversion: 2.1 time: 0.098813 Oct 04 05:49:04.258208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 435/907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:04 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1621 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:05.205954 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:05.206896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:05.213120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:05.216672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:05.216672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:05.216672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:05.216672 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:05.217055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:05.281234 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:05.282502 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:05.289394 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:05.289888 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:05.290353 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:05.291059 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:05.291517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:05.291942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:05.327244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:05.327757 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:05.328208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:05.328655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'fault' on Instance uuid 6ef1eaae-b386-4ce1-9d08-63972bda8851 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:05.350502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:05.362042 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:05.363885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:05.365135 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b622006e-b9f0-47e3-a3e4-cc9345bff6ec tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1742 microversion: 2.20 time: 0.164167 Oct 04 05:49:05.365878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 473/908] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:05 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:05.370763 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:05.379304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a93bfd07-1ec7-4fc0-8e36-d198e97e7592 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 200 len: 1334 microversion: 2.1 time: 0.102070 Oct 04 05:49:05.380298 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 436/909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:05 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:06.393779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:06.394404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:06.402130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:06.402344 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:06.402840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:06.403114 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:06.403810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:06.403934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 6ef1eaae-b386-4ce1-9d08-63972bda8851] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:06.404255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:06.404830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:06.412067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:06.412455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:06.413000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:06.413582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:06.414161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:06.414474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:06.428506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] HTTP exception thrown: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 could not be found. Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Request method failure captured: Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 HTTP/1.1 Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8gw41q9dwS_KnobwoDRNzhRJFIsISD2v3S5ulTMXUx99p89WzzUPyTq164ojGmXyTNImVDrM33A2S1oGuxmLS6UEjkrhDk23xPZf130OIwZNI6AUJFHJHKumSPZmuNeiOmQGJnVC4jSFiG1TWA_V9v-Mk5QSoUeuaPLSaNwHKT78_Q Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:06.430185 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_689c4759cb5943b79f2637a8e29e230e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}] Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c1b48a973c20470a9af23c77e3da5b72 Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 could not be found. Oct 04 05:49:06.432001 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '6ef1eaae-b386-4ce1-9d08-63972bda8851'} Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 could not be found. Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:06.432824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 could not be found. Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 could not be found. Oct 04 05:49:06.434103 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:06.439542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Returning 404 to user: Instance 6ef1eaae-b386-4ce1-9d08-63972bda8851 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:06.439542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7888829d-b882-42ae-b270-494c0ca11f74 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851" status: 404 len: 111 microversion: 2.1 time: 0.033155 Oct 04 05:49:06.439542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 437/910] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:06 2022] GET /compute/v2.1/servers/6ef1eaae-b386-4ce1-9d08-63972bda8851 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:49:06.441053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-19e8072f-d4e4-4684-91fd-ea597ea723d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '.version_select at 0x7f048636a5e0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:06.498766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-19e8072f-d4e4-4684-91fd-ea597ea723d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683898245" status: 202 len: 0 microversion: 2.1 time: 0.062240 Oct 04 05:49:06.501247 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 438/911] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 05:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683898245 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:49:06.583528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:06.592036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:06.593497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:06.594712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-84a92785-ba95-4040-ad1b-089b3283a836 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.205451 Oct 04 05:49:06.609855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 474/912] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:06 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:07.475849 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-c8c8c87f-9547-495a-98f4-973fd87cf00d req-92216429-4d98-4ba0-89b7-149ff65430b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "name": "network-vif-plugged", "status": "completed", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:07.487998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-c8c8c87f-9547-495a-98f4-973fd87cf00d req-92216429-4d98-4ba0-89b7-149ff65430b8 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:07.493208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-c8c8c87f-9547-495a-98f4-973fd87cf00d req-92216429-4d98-4ba0-89b7-149ff65430b8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:07.493208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-c8c8c87f-9547-495a-98f4-973fd87cf00d req-92216429-4d98-4ba0-89b7-149ff65430b8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:07.502853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-c8c8c87f-9547-495a-98f4-973fd87cf00d req-92216429-4d98-4ba0-89b7-149ff65430b8 service nova] Creating event network-vif-plugged:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:49:07.508452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-c8c8c87f-9547-495a-98f4-973fd87cf00d req-92216429-4d98-4ba0-89b7-149ff65430b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201853 Oct 04 05:49:07.509572 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 439/913] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:07.621033 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:07.621615 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:07.632258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:07.632744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:07.634745 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:07.635500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:07.636164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:07.636611 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:07.806804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:07.820740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:07.822676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:07.824955 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6be15727-3bda-44ac-8303-fa4b1ea772f9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.207570 Oct 04 05:49:07.826974 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 475/914] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:07 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:08.858248 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:08.860484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:08.862714 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:08.867697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:08.868239 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:08.868877 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:08.869986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:08.870518 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:08.871135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:09.051045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:09.059685 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:09.061888 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:09.063361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dcca57df-04b9-4bf5-b65c-43647ebe0de6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.210232 Oct 04 05:49:09.064153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 440/915] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:08 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:10.090437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:10.091710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:10.099249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:10.099980 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:10.100586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:10.101500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:10.102109 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:10.102815 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:10.206401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:10.206935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:10.214542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:10.215246 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:10.215893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:10.216759 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:10.217424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:10.218014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:10.250020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:49:10.264568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:10.273919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:10.286438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:10.286438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-eea93234-0612-49c3-8fd7-23eb2bfe0cb2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.194695 Oct 04 05:49:10.286438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 476/916] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:10 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:10.553658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e8778904-93c0-4ef3-ba6c-7a94e451a8e1 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 204 len: 0 microversion: 2.1 time: 0.351209 Oct 04 05:49:10.554385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 441/917] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:10 2022] DELETE /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:49:10.563834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:10.564441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:10.571338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:10.571828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:10.572270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:10.573000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:10.573455 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:10.573884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:10.716182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:10.725310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-75aedc72-a7ef-475f-8498-79f424c8256a tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1508 microversion: 2.1 time: 0.165355 Oct 04 05:49:10.726345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 477/918] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:10 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:11.216906 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:11.217545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:11.224740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:11.225506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:11.226251 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:11.227198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:11.227994 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:11.228973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:11.254214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-556a19ac-7632-4d75-ae5e-8bdadd6abf05 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/ips" status: 200 len: 150 microversion: 2.1 time: 0.041817 Oct 04 05:49:11.258755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 442/919] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:49:11 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:11.307641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:11.309005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:11.325544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:11.326046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:11.326508 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:11.327219 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:11.328207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:11.328623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:11.495320 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:11.505208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:11.506690 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:11.508064 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5d39c9c5-926c-4a9f-b7ac-3425ced29f23 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.204399 Oct 04 05:49:11.508813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 478/920] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:11 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:11.750766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:11.751304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:11.760840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:11.761687 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:11.762476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:11.767274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:11.767274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:11.767274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:11.942748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:11.961503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8d86385b-d939-4943-b0c5-e02ce5448cfd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1508 microversion: 2.1 time: 0.215615 Oct 04 05:49:11.962439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 443/921] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:11 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:12.533540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:12.534262 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:12.541379 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:12.541855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:12.542323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:12.543007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:12.543525 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:12.543984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:12.679367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:12.688647 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:12.732007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:12.732007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4db4bdd1-cf41-4cc6-8bb1-5f9b99540aca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.162333 Oct 04 05:49:12.732007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 479/922] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:12 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:12.990418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:12.991000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:12.997438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:12.997921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:12.998379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:12.999070 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:12.999761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:13.000198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:13.079227 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "081eefeb-8797-489e-ab18-3dfb60b36365"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:13.081970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:13.089047 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:13.089777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:13.090400 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:13.091298 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:13.091914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:13.092503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:13.188015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:13.201342 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-bb8614e7-aacf-4116-8619-13df99bf92cd tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1508 microversion: 2.1 time: 0.217932 Oct 04 05:49:13.204889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 444/923] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:12 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:13.756261 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:13.757279 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:13.763393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:13.764036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:13.764658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:13.765888 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:13.766524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:13.767186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:13.918916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:13.928200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:13.929676 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:13.930863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e309d73a-f357-4294-93f0-2bce6f9794e2 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.178546 Oct 04 05:49:13.931599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 445/924] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:13 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:14.229033 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:14.230551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:14.238224 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.239211 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.239840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.243383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.243383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.243383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.477383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:14.497841 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-140d6148-65c1-405c-b380-480dfd5986a4 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1508 microversion: 2.1 time: 0.270473 Oct 04 05:49:14.498527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 446/925] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:14 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:14.678343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:14.680608 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:14.690713 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.691574 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.694339 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.695296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.695922 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.696508 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.743346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3bafd279-54c9-4e74-b6de-a241d239c462 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068776 Oct 04 05:49:14.746177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 447/926] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:14 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:14.763432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-60158922-8942-4eb1-bb25-a56cf5fc4195 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "POST /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.688447 Oct 04 05:49:14.765050 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 480/927] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 4 05:49:13 2022] POST /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments => generated 194 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:14.898936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:14.899379 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:14.918951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.918951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.918951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.918951 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.919313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.919313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.928985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-52787c43-0447-4282-94eb-958b736309a1 req-23d2c894-c3ed-48d7-b4f0-11f8bb9d2a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b22d78-62a0-4440-8cae-c8e5b37e99fa", "name": "network-vif-deleted", "tag": "e6548b2f-6183-4b2b-aebf-1a0952863241"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:14.944032 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-52787c43-0447-4282-94eb-958b736309a1 req-23d2c894-c3ed-48d7-b4f0-11f8bb9d2a4b service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.944649 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-52787c43-0447-4282-94eb-958b736309a1 req-23d2c894-c3ed-48d7-b4f0-11f8bb9d2a4b service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.945175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-52787c43-0447-4282-94eb-958b736309a1 req-23d2c894-c3ed-48d7-b4f0-11f8bb9d2a4b service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.958857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-52787c43-0447-4282-94eb-958b736309a1 req-23d2c894-c3ed-48d7-b4f0-11f8bb9d2a4b service nova] Creating event network-vif-deleted:e6548b2f-6183-4b2b-aebf-1a0952863241 for instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa on hv-cinder-84914 Oct 04 05:49:14.964270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-52787c43-0447-4282-94eb-958b736309a1 req-23d2c894-c3ed-48d7-b4f0-11f8bb9d2a4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040242 Oct 04 05:49:14.969421 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 481/928] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:14.974747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a9c18b35-0b64-4f5d-b001-413613e5829f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/9159bee4-6833-4d51-9288-b8256a669ee7" status: 200 len: 194 microversion: 2.1 time: 0.080142 Oct 04 05:49:14.975416 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:14.976192 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:14.982666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 448/929] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 4 05:49:14 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/9159bee4-6833-4d51-9288-b8256a669ee7 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:14.983625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.984303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.984830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.985715 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:14.986292 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:14.986822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:14.993276 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:14.994553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:15.002362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:15.003240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:15.004130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:15.006730 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:15.007552 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:15.008177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:15.024644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:15.157566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'services' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:15.266043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:15.266043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:15.267381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:15.267381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8ed46a1c-2903-4bf2-a1fe-1c23bbe46007 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.242822 Oct 04 05:49:15.267381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 482/930] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:14 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:15.431321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-996e233a-e0ac-4d6d-80b6-3cef023da8d0 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/9159bee4-6833-4d51-9288-b8256a669ee7" status: 202 len: 0 microversion: 2.1 time: 0.443821 Oct 04 05:49:15.432840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 449/931] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:49:14 2022] DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/9159bee4-6833-4d51-9288-b8256a669ee7 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:49:15.527668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:15.527668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:15.532409 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:15.533241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:15.533930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:15.534999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:15.535249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:15.535840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:15.580945 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:15.581801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:15.582433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:15.583033 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'fault' on Instance uuid 98b22d78-62a0-4440-8cae-c8e5b37e99fa {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:15.632621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:15.643020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-952ddd5c-ea0c-48e6-b7f4-c2bd1f6da4b0 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1312 microversion: 2.1 time: 0.124264 Oct 04 05:49:15.643837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 483/932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:15 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:16.245156 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:16.245934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:16.252373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:16.252850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:16.253306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:16.254036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:16.254521 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:16.254932 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:16.275016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:16.395823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:16.403914 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:16.405554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:16.408385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cc0f4bc6-9ccc-4e0e-8a47-4fed2f0e7a47 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.168756 Oct 04 05:49:16.408636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 450/933] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:16 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:16.668273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:16.668898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:16.676130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:16.676608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:16.677194 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:16.677921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:16.678392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:16.679017 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:16.719487 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:16.719964 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:16.720392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:16.720848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'fault' on Instance uuid 98b22d78-62a0-4440-8cae-c8e5b37e99fa {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:16.766467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:16.773668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7afe8d3c-42eb-453b-b2b9-ab943311e8d7 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 200 len: 1312 microversion: 2.1 time: 0.109804 Oct 04 05:49:16.789187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 484/934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:16 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:17.432872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:17.433475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:17.441372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:17.441855 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:17.442375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:17.443021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:17.443469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:17.443896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:17.580303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:17.599125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:17.600588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:17.601788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2270b162-91d9-4e66-957d-08f49730677f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1737 microversion: 2.20 time: 0.172829 Oct 04 05:49:17.603709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 451/935] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:17 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:17.898331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:17.898947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: 98b22d78-62a0-4440-8cae-c8e5b37e99fa] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:17.904877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:17.905362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:17.905798 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:17.906532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:17.906979 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:17.907408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:17.920227 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] HTTP exception thrown: Instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa could not be found. Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Request method failure captured: Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa HTTP/1.1 Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8gw41q9dwS_KnobwoDRNzhRJFIsISD2v3S5ulTMXUx99p89WzzUPyTq164ojGmXyTNImVDrM33A2S1oGuxmLS6UEjkrhDk23xPZf130OIwZNI6AUJFHJHKumSPZmuNeiOmQGJnVC4jSFiG1TWA_V9v-Mk5QSoUeuaPLSaNwHKT78_Q Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:17.922362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_689c4759cb5943b79f2637a8e29e230e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}] Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c1b48a973c20470a9af23c77e3da5b72 Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa could not be found. Oct 04 05:49:17.924092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '98b22d78-62a0-4440-8cae-c8e5b37e99fa'} Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa could not be found. Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:17.924909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa could not be found. Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa could not be found. Oct 04 05:49:17.926352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:17.927822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Returning 404 to user: Instance 98b22d78-62a0-4440-8cae-c8e5b37e99fa could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:17.927822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f388e5da-1321-42c9-b386-ba7748bcd784 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa" status: 404 len: 111 microversion: 2.1 time: 0.131057 Oct 04 05:49:17.927822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 485/936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:17 2022] GET /compute/v2.1/servers/98b22d78-62a0-4440-8cae-c8e5b37e99fa => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:17.932182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:17.932673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:17.939382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:17.939862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:17.940565 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:17.941249 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:17.941697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:17.942122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:17.965971 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:49:18.209768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-01837c15-15d1-4931-b710-24634e46bb4d tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 204 len: 0 microversion: 2.1 time: 0.281033 Oct 04 05:49:18.210330 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 452/937] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:17 2022] DELETE /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:49:18.218693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:18.219293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:18.225143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:18.228571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:18.228571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:18.228571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:18.228571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:18.228983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:18.355117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:18.363850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1cce474b-33e8-4c48-99c2-76ecd53c4375 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.149363 Oct 04 05:49:18.364424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 486/938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:18 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:49:18.628719 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:18.629412 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:18.635822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:18.636303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:18.636740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:18.637424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:18.637874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:18.638352 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:18.764734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:18.773370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:18.774962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:18.776122 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dae287be-a4d9-4dd3-955c-1703cbc82beb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.151772 Oct 04 05:49:18.776677 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 453/939] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:18 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:19.386390 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:19.386994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:19.393371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:19.393845 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:19.394306 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:19.394984 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:19.395435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:19.395855 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:19.522779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:19.530362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fab1d7a3-f27a-496c-99e7-b399a1cbf904 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.147819 Oct 04 05:49:19.530920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 487/940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:19 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:19.803210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:19.803809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:19.810392 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:19.810868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:19.811296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:19.812017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:19.812455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:19.812911 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:19.938182 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:19.946428 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:19.947870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:19.949021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-84913e13-6ea6-4757-b1d4-6d7dfc84d0e8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.149744 Oct 04 05:49:19.949586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 454/941] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:19 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:20.553062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:20.553613 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:20.560045 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:20.560518 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:20.560953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:20.562162 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:20.562631 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:20.563056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:20.686333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:20.694663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0c247024-aca5-48ee-a1f2-332b148d8d80 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.145530 Oct 04 05:49:20.695216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 488/942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:20 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:20.974430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:20.975040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:20.981545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:20.982020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:20.982498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:20.983184 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:20.984130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:20.984554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:21.113974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:21.122267 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:21.123736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:21.124910 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c7e0c33c-a622-4f14-a28c-234dd3e92cb9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.154465 Oct 04 05:49:21.125477 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 455/943] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:20 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:21.132119 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-f9cb872e-ddde-48ef-b135-2021122efb67 req-e542bd46-2a5b-4cf8-b788-fb799126e54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "name": "network-vif-unplugged", "status": "completed", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:21.141875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-f9cb872e-ddde-48ef-b135-2021122efb67 req-e542bd46-2a5b-4cf8-b788-fb799126e54a service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:21.142381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-f9cb872e-ddde-48ef-b135-2021122efb67 req-e542bd46-2a5b-4cf8-b788-fb799126e54a service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:21.142818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-f9cb872e-ddde-48ef-b135-2021122efb67 req-e542bd46-2a5b-4cf8-b788-fb799126e54a service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:21.153532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-f9cb872e-ddde-48ef-b135-2021122efb67 req-e542bd46-2a5b-4cf8-b788-fb799126e54a service nova] Creating event network-vif-unplugged:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:49:21.158950 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-f9cb872e-ddde-48ef-b135-2021122efb67 req-e542bd46-2a5b-4cf8-b788-fb799126e54a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030503 Oct 04 05:49:21.159516 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 489/944] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:21.724726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:21.725331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:21.731406 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:21.731894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:21.732331 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:21.733020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:21.733517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:21.733946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:21.882647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:21.896119 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7a916050-d0c0-4036-90dc-df0b2c0e01aa tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.175053 Oct 04 05:49:21.897128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 456/945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:21 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:22.151371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:22.152061 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:22.158209 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:22.158686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:22.159120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:22.159806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:22.160251 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:22.160689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:22.292048 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:22.301431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:22.302999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:22.304158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b957e16d-7137-43db-b04f-25f78f3aba5b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.157575 Oct 04 05:49:22.304721 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 490/946] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:22 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:22.920065 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:22.920673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:22.928168 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:22.928808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:22.929495 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:22.931308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:22.932014 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:22.932369 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.160368 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:23.167916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-384852c9-1983-403d-8a69-f79db0d24dad tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1521 microversion: 2.1 time: 0.251989 Oct 04 05:49:23.168479 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 457/947] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:22 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:23.333371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:23.334018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:23.344584 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.345324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.345772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.346523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.347138 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.347772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.398737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-b252f443-3aa9-4d99-a0b5-9d0dcf4102fc req-fb6fb4bc-b19e-4056-b273-237febf8cac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27eb826-a49d-4d1d-a843-cc725fae592b", "name": "network-vif-deleted", "tag": "1c9ceaa0-2adc-4ea7-892e-2a41d1c48287"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:23.408677 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b252f443-3aa9-4d99-a0b5-9d0dcf4102fc req-fb6fb4bc-b19e-4056-b273-237febf8cac3 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.409146 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b252f443-3aa9-4d99-a0b5-9d0dcf4102fc req-fb6fb4bc-b19e-4056-b273-237febf8cac3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.409574 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b252f443-3aa9-4d99-a0b5-9d0dcf4102fc req-fb6fb4bc-b19e-4056-b273-237febf8cac3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.422311 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-b252f443-3aa9-4d99-a0b5-9d0dcf4102fc req-fb6fb4bc-b19e-4056-b273-237febf8cac3 service nova] Creating event network-vif-deleted:1c9ceaa0-2adc-4ea7-892e-2a41d1c48287 for instance f27eb826-a49d-4d1d-a843-cc725fae592b on hv-cinder-84914 Oct 04 05:49:23.427775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-b252f443-3aa9-4d99-a0b5-9d0dcf4102fc req-fb6fb4bc-b19e-4056-b273-237febf8cac3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Oct 04 05:49:23.428377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 458/948] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:23.494073 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:23.503668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:23.508868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:23.508868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6fdbbd35-94a9-4a96-8b15-f24f359088da tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.177551 Oct 04 05:49:23.508868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 491/949] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:23 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:23.596505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:23.597077 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:23.603313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.603743 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.604173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.604854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.605299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.605719 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.685387 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'services' on Instance uuid e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:23.895545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-acff9af9-e73b-4cbf-ab93-fe6df7df84ec tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments/081eefeb-8797-489e-ab18-3dfb60b36365" status: 202 len: 0 microversion: 2.1 time: 0.303083 Oct 04 05:49:23.896287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 459/950] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:49:23 2022] DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments/081eefeb-8797-489e-ab18-3dfb60b36365 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:49:23.904392 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:23.906598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:23.912515 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.912995 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.913433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.914117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:23.914602 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:23.915081 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:23.945106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-13cce200-4cb9-4ca7-b43c-1213b5e013e8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Oct 04 05:49:23.945659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 492/951] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:23 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:24.191347 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:24.191975 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:24.198050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:24.198570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:24.199005 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:24.199684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:24.200128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:24.200548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:24.261933 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:24.269721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7d687ccc-de38-4ce4-9372-5c426c03b2f8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1479 microversion: 2.1 time: 0.083406 Oct 04 05:49:24.270328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 460/952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:24 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1479 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:24.535733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:24.536282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:24.542940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:24.543415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:24.543850 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:24.544524 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:24.544971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:24.545394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:24.671404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:24.679375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:24.680798 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:24.681937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d66cdf42-639d-4f01-90b8-62cf1ebf27ae tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.153014 Oct 04 05:49:24.682522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 493/953] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:24 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:24.958217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:24.960415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:24.966460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:24.966941 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:24.967380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:24.968095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:24.968547 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:24.968971 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:24.997461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-54f8dba6-ce89-4b7e-bc86-2d00bb1e0ae0 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Oct 04 05:49:24.998010 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 461/954] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:24 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:25.292727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:25.293333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:25.300279 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:25.300768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:25.301200 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:25.301891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:25.302374 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:25.302799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:25.367477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:25.376018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ee258b8e-9663-4f29-bb97-6ac28cda56a8 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1306 microversion: 2.1 time: 0.087120 Oct 04 05:49:25.376570 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 494/955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:25 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:25.707391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:25.707995 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:25.714590 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:25.715092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:25.715520 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:25.716274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:25.716657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:25.717073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:25.847389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:25.855542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:25.857208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:25.858998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6ef94473-c61f-46e3-bbba-db895a41b01a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1719 microversion: 2.20 time: 0.154988 Oct 04 05:49:25.859556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 462/956] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:25 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:26.010516 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:26.012600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:26.019433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.019921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.020353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:26.024102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.024102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.024102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:26.051185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-73636ae0-45e0-4706-8c97-16df4685c4f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Oct 04 05:49:26.051739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 495/957] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:26 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:26.399348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:26.399977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:26.405967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.406529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.406962 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:26.407638 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.408083 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.408504 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:26.437965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.438468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.438897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:26.439327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lazy-loading 'fault' on Instance uuid f27eb826-a49d-4d1d-a843-cc725fae592b {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:26.478849 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b48a973c20470a9af23c77e3da5b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689c4759cb5943b79f2637a8e29e230e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:26.486376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-684aca21-4620-41fe-ac3b-f9cbd8dc7113 tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 200 len: 1311 microversion: 2.1 time: 0.090920 Oct 04 05:49:26.487064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 463/958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:26 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:26.883881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:26.884724 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:26.894104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.894104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.894104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:26.894104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:26.894530 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:26.894863 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.038623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:27.046614 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:27.048558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:27.049752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-dfd62699-a72e-4872-9177-bbee1be9fb7c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1722 microversion: 2.20 time: 0.170211 Oct 04 05:49:27.050328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 496/959] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:26 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:27.064396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:27.067214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:27.073709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.074284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.079705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.079705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.079705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.079705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.080177 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0f18cdc-e25e-4411-92f2-87a2a19016be"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:27.080177 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:27.085328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.085819 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.086299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.087002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.087490 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.087920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.108244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-98108525-fad7-4934-932d-bb210360b7f8 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048500 Oct 04 05:49:27.108785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 464/960] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:27 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:27.217885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:27.218394 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:27.224946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.225309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.225732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.226448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.226893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.227312 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.231048 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:27.256802 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f961fc15-b69f-43b1-b9b7-dd1f48c72c73 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/4b652924-9ece-4585-8e3f-0a6f49b321a6" status: 200 len: 194 microversion: 2.1 time: 0.042874 Oct 04 05:49:27.257386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 465/961] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 4 05:49:27 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/4b652924-9ece-4585-8e3f-0a6f49b321a6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:27.267487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:27.267970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:27.277559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.277559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.277559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.277559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.277980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.277980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.364334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'services' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:27.632023 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-988e2185-4603-4964-9249-cc3807cfd681 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/4b652924-9ece-4585-8e3f-0a6f49b321a6" status: 202 len: 0 microversion: 2.1 time: 0.367912 Oct 04 05:49:27.632702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 466/962] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 4 05:49:27 2022] DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments/4b652924-9ece-4585-8e3f-0a6f49b321a6 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 05:49:27.638075 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:27.638746 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] [instance: f27eb826-a49d-4d1d-a843-cc725fae592b] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:27.655754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.655754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.655754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.655754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:27.656735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:27.656735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:27.661808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] HTTP exception thrown: Instance f27eb826-a49d-4d1d-a843-cc725fae592b could not be found. Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Request method failure captured: Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b HTTP/1.1 Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8gw41q9dwS_KnobwoDRNzhRJFIsISD2v3S5ulTMXUx99p89WzzUPyTq164ojGmXyTNImVDrM33A2S1oGuxmLS6UEjkrhDk23xPZf130OIwZNI6AUJFHJHKumSPZmuNeiOmQGJnVC4jSFiG1TWA_V9v-Mk5QSoUeuaPLSaNwHKT78_Q Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:27.663537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_689c4759cb5943b79f2637a8e29e230e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/689c4759cb5943b79f2637a8e29e230e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/689c4759cb5943b79f2637a8e29e230e"}]}] Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 689c4759cb5943b79f2637a8e29e230e Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007331953 Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c1b48a973c20470a9af23c77e3da5b72 Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007331953-project Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance f27eb826-a49d-4d1d-a843-cc725fae592b could not be found. Oct 04 05:49:27.664956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'f27eb826-a49d-4d1d-a843-cc725fae592b'} Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27eb826-a49d-4d1d-a843-cc725fae592b could not be found. Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:27.665779 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27eb826-a49d-4d1d-a843-cc725fae592b could not be found. Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27eb826-a49d-4d1d-a843-cc725fae592b could not be found. Oct 04 05:49:27.667217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:27.668573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] Returning 404 to user: Instance f27eb826-a49d-4d1d-a843-cc725fae592b could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:27.668573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-985f4afd-0971-4543-a1b7-13337ffc0f5e tempest-ServerRescueNegativeTestJSON-2007331953 tempest-ServerRescueNegativeTestJSON-2007331953-project] 10.222.0.26 "GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b" status: 404 len: 111 microversion: 2.1 time: 0.031075 Oct 04 05:49:27.668573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 467/963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:27 2022] GET /compute/v2.1/servers/f27eb826-a49d-4d1d-a843-cc725fae592b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:28.110673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:28.121391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:28.124302 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:28.131596 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.132283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.137442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.137442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.137442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.137442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.164926 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-55ba03df-a083-48c1-837d-05cdeb98093f tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047775 Oct 04 05:49:28.166193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 468/964] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:28 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:49:28.222767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8d99679b-2831-4e9c-8ed5-54032663ceca tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.148816 Oct 04 05:49:28.222767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 497/965] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 4 05:49:27 2022] POST /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-volume_attachments => generated 188 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 05:49:28.239227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:28.239732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:28.246025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.246891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.247157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.247847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.250054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.250054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.275547 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:49:28.366453 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:28.366868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:28.374182 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.374707 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.375173 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.375889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.376346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.376773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.645020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b1d8740d-bc66-476f-ae45-3709bc521f6d tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 204 len: 0 microversion: 2.1 time: 0.409750 Oct 04 05:49:28.645523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 469/966] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:28 2022] DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 05:49:28.654472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:28.655170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:28.661428 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.661913 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.662377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:28.663106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:28.663541 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:28.663961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:29.002498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:29.010482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7bc7efc6-9570-4bb8-8a3e-249922f51472 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1683 microversion: 2.1 time: 0.360047 Oct 04 05:49:29.025847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 470/967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:28 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1683 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:49:29.219788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-56812bcb-cff8-4523-8e7e-651a3950feeb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-volume_attachments/a0f18cdc-e25e-4411-92f2-87a2a19016be" status: 202 len: 0 microversion: 2.20 time: 0.857920 Oct 04 05:49:29.220932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 498/968] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 4 05:49:28 2022] DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-volume_attachments/a0f18cdc-e25e-4411-92f2-87a2a19016be => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 05:49:29.289747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:29.290452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:29.297762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:29.301581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:29.301581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:29.301581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:29.301581 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:29.301957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:29.348782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127393) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 05:49:29.584029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7c14cdb7-fd40-4077-8dc0-ef07879108d6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "POST /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/action" status: 202 len: 0 microversion: 2.20 time: 0.298920 Oct 04 05:49:29.587186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 471/969] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 4 05:49:29 2022] POST /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:49:29.594866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:29.594977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:29.601288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:29.601772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:29.602623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:29.603349 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:29.603808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:29.604237 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:29.739106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:29.745536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:29.747019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:29.748179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2c8dec5a-198f-448f-86e3-a89022a2e028 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1670 microversion: 2.20 time: 0.158976 Oct 04 05:49:29.756809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 499/970] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:29 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:30.034806 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:30.035647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:30.042943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:30.045560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:30.045560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:30.045560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:30.046337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:30.046940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:30.068699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:30.071150 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:30.081789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:30.083282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:30.083885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:30.084920 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:30.085539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:30.087144 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:30.120661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e56479a0-aed5-44d6-a575-720cd67a7af8 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059247 Oct 04 05:49:30.121442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 500/971] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:30 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:30.273513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:30.281620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2e16d25a-e220-4d99-a543-2871a6e081f1 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1683 microversion: 2.1 time: 0.251986 Oct 04 05:49:30.282220 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 472/972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:30 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1683 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:30.782768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:30.783402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:30.785727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=76 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:30.790435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:30.790901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:30.791335 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:30.792020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:30.792467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:30.792889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:30.935357 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:30.944081 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:30.945645 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:30.946869 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-083b7f62-5a99-4b28-99c0-abaa29842eb6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1670 microversion: 2.20 time: 0.168152 Oct 04 05:49:30.947438 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 501/973] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:30 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:31.137114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:31.140223 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:31.156660 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.157431 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.158177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.159545 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.160151 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.161173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.200042 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8b87a057-600d-4c00-9efb-50002019a397 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070025 Oct 04 05:49:31.202295 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 473/974] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:31 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 05:49:31.312089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:31.312089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:31.313656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.318597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.319420 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.320312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.322688 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.323309 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.333166 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:31.335560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:31.342986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.344298 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.345300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.347582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.348764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.349349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.417721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-461f0d64-50d9-4e02-97e6-7a37a3478801 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088449 Oct 04 05:49:31.418642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 474/975] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 4 05:49:31 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 05:49:31.514070 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:31.524718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:31.524718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.524718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.524718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.525359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.525524 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.525996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.582087 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:49:31.707706 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:31.719180 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-560243be-c91b-44f9-8070-1a689cc14212 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1683 microversion: 2.1 time: 0.417963 Oct 04 05:49:31.719768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 502/976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:31 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1683 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:31.923974 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-4ac2886e-3470-48f6-bfa9-e09caf94461a req-a1ba882d-efa5-4c77-a33e-4c90fd0606b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a236b9-6696-4cc5-9cd3-c0784a5f9df4", "name": "network-vif-deleted", "tag": "61425b0d-a5a9-464e-a54a-4afd7be1d75c"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:31.934218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-4ac2886e-3470-48f6-bfa9-e09caf94461a req-a1ba882d-efa5-4c77-a33e-4c90fd0606b4 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.935293 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-4ac2886e-3470-48f6-bfa9-e09caf94461a req-a1ba882d-efa5-4c77-a33e-4c90fd0606b4 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.935940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-4ac2886e-3470-48f6-bfa9-e09caf94461a req-a1ba882d-efa5-4c77-a33e-4c90fd0606b4 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.946420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:31.950867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-4ac2886e-3470-48f6-bfa9-e09caf94461a req-a1ba882d-efa5-4c77-a33e-4c90fd0606b4 service nova] Creating event network-vif-deleted:61425b0d-a5a9-464e-a54a-4afd7be1d75c for instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 on hv-cinder-84914 Oct 04 05:49:31.957299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-4ac2886e-3470-48f6-bfa9-e09caf94461a req-a1ba882d-efa5-4c77-a33e-4c90fd0606b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040272 Oct 04 05:49:31.958005 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 503/977] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:31.979585 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:31.988948 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:31.988948 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.988948 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.989553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:31.990607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:31.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:31.991674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:32.092510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c9e335a7-70cf-41d8-98a3-c23e27730df9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 204 len: 0 microversion: 2.1 time: 0.570534 Oct 04 05:49:32.092510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 475/978] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:31 2022] DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:49:32.098858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:32.100130 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:32.110126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:32.114742 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:32.119788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:32.120942 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:32.121633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:32.122169 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:32.294761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:32.303635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-993f95f5-3cd1-430c-883d-9cb4a8f145f3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1672 microversion: 2.1 time: 0.215047 Oct 04 05:49:32.307740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 476/979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:32 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1672 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:49:32.320918 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:32.330478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:32.331992 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:32.333210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-104efe50-5a5f-450c-9a05-1c281f626e52 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.362900 Oct 04 05:49:32.333930 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 504/980] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:31 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:32.745052 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:32.745728 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:32.753208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:32.753701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:32.754338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:32.755237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:32.755695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:32.756190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:32.775444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:32.821068 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:32.829729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7e73c355-e447-4863-ba59-398d7c6c29e3 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1327 microversion: 2.1 time: 0.088550 Oct 04 05:49:32.830204 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 477/981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:32 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:33.327810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:33.328591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:33.335303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:33.335771 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:33.336202 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:33.336886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:33.337333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:33.337751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:33.363430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:33.364127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:33.371747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:33.373484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:33.373484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:33.373484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:33.374000 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:33.374655 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:33.473853 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:33.481891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-050da9eb-96f5-486e-a2b8-b7de85d1d4c2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1672 microversion: 2.1 time: 0.157863 Oct 04 05:49:33.482502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 505/982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:33 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:33.515835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:33.529258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:33.532316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:33.534793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8e852385-005f-4bfe-ae62-128feb8b9031 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.174849 Oct 04 05:49:33.534793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 478/983] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:33 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:33.852549 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:33.853153 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:33.860014 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:33.860492 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:33.860919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:33.861842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:33.862330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:33.862748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:33.933449 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:33.942364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7be810a8-7317-4e77-b819-0dd6322d8a31 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1327 microversion: 2.1 time: 0.093709 Oct 04 05:49:33.942931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 506/984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:33 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:34.507884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:34.508579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:34.515559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:34.516051 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:34.516491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:34.517194 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:34.517683 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:34.518072 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:34.558934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:34.560049 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:34.570864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:34.571346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:34.572243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:34.573347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:34.574308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:34.574931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:34.724206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:34.733288 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:34.735947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:34.738411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-38ba7e26-df52-42c0-8eb4-8ca22f7bafb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.182850 Oct 04 05:49:34.738639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 507/985] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:34 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:34.872475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:34.881288 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b432d72c-6de6-4ecf-9ddd-9e6f0a92b1ca tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1672 microversion: 2.1 time: 0.377330 Oct 04 05:49:34.895487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 479/986] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:34 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1672 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:34.966375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:34.967272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:34.974162 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:34.974975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:34.975491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:34.976384 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:34.976848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:34.977276 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:35.010044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:35.010856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:35.011305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:35.011750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lazy-loading 'fault' on Instance uuid e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:35.056119 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c66c7ddbf18d4f1fb8c890f548031f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b850d4b5df4a4e93720cb855add44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:35.066051 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c0cfbda3-c015-4d4b-86d5-541e93f4fe69 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 200 len: 1332 microversion: 2.1 time: 0.102618 Oct 04 05:49:35.070312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 508/987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:34 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:35.763003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:35.763666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:35.769815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:35.770322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:35.770756 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:35.771448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:35.771899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:35.772323 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:35.906617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:35.907333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:35.915199 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:35.915684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:35.916119 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:35.916814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:35.917366 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:35.917928 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:35.978391 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:35.987609 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:36.008410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:36.008599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:36.008599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-68dcd75c-73ef-4a57-855d-79b4e65a0ce9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.231543 Oct 04 05:49:36.008599 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 480/988] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:35 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:36.008867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-678bcfa7-a11c-4757-bd33-1549861d96bf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1604 microversion: 2.1 time: 0.093827 Oct 04 05:49:36.008867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 509/989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:35 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:49:36.091946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:36.092603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:36.099880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:36.100368 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:36.100808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:36.101536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:36.102008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:36.102692 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:36.117590 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 HTTP/1.1 Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:36.119318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:36.120829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'e8a236b9-6696-4cc5-9cd3-c0784a5f9df4'} Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:36.121652 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:36.123371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:36.125140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:36.125140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-700d1d8c-7030-4405-99e8-2aeacdcc92fe tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 404 len: 111 microversion: 2.1 time: 0.032957 Oct 04 05:49:36.125140 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 481/990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:36 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:49:36.130020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a4184e13-b876-4353-8d1e-77f10a9a41d4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '.version_select at 0x7f04865c39d0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:36.214179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-fc1360d6-7662-4da3-80c7-3bf0745f9bba req-22d647cc-d958-4ee3-b713-02b55d5c77d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a0814e-8898-4c71-87fc-1ced0aa84ba4", "name": "network-vif-deleted", "tag": "cc21ab55-5520-44ff-9fa8-6eca7297581f"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:36.229712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fc1360d6-7662-4da3-80c7-3bf0745f9bba req-22d647cc-d958-4ee3-b713-02b55d5c77d3 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:36.230551 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fc1360d6-7662-4da3-80c7-3bf0745f9bba req-22d647cc-d958-4ee3-b713-02b55d5c77d3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:36.231548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-fc1360d6-7662-4da3-80c7-3bf0745f9bba req-22d647cc-d958-4ee3-b713-02b55d5c77d3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:36.246784 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a4184e13-b876-4353-8d1e-77f10a9a41d4 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093795458" status: 202 len: 0 microversion: 2.1 time: 0.120750 Oct 04 05:49:36.248698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 510/991] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 05:49:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093795458 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:49:36.254109 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-fc1360d6-7662-4da3-80c7-3bf0745f9bba req-22d647cc-d958-4ee3-b713-02b55d5c77d3 service nova] Creating event network-vif-deleted:cc21ab55-5520-44ff-9fa8-6eca7297581f for instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 on hv-cinder-84914 Oct 04 05:49:36.261850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-fc1360d6-7662-4da3-80c7-3bf0745f9bba req-22d647cc-d958-4ee3-b713-02b55d5c77d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050867 Oct 04 05:49:36.262997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 482/992] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:49:37.021159 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:37.021883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:37.023460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:37.024068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:37.034758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:37.035415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:37.035859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:37.036566 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:37.037017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:37.037444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:37.037669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:37.038186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:37.038661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:37.039415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:37.039898 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:37.040334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:37.136316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:37.144615 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:37.145285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:37.145965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:37.289935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:37.300450 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:37.301408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:37.302934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:37.304332 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9c9cf9c8-15c6-4f7e-a5b4-04cfe4803d8a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.292913 Oct 04 05:49:37.322008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 511/993] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:37 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:37.322890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9c9f9619-65d2-4ff7-9f6b-6760908218cf tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.296480 Oct 04 05:49:37.332945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 483/994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:37 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:38.330772 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:38.332201 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:38.341594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:38.342112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.342252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.342644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.343365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.343487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:38.343817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.344242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.350829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.352469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.352469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.352469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.353231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.353875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.409194 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.409947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.410571 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.411176 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:38.474355 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:38.482707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b70f6beb-c0f0-448e-acb1-c40b1e354045 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.147270 Oct 04 05:49:38.493506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 484/995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:38 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:38.516625 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:38.518990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:38.525982 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:38.529102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:38.529102 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5e03b0d5-2483-46e3-b515-0e4be52e50b6 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.203774 Oct 04 05:49:38.530032 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 512/996] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:38 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:38.743363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:38.744800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:38.750734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.751456 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.752081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.753004 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.753623 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.754240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.769327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 HTTP/1.1 Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:38.771317 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.772945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'e8a236b9-6696-4cc5-9cd3-c0784a5f9df4'} Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:38.773856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.775460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.777603 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:38.778493 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b4e9bffc-939c-424d-8a1f-b2e4ce9bed28 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 404 len: 111 microversion: 2.1 time: 0.039038 Oct 04 05:49:38.779061 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 485/997] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:38 2022] DELETE /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:49:38.787481 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:38.788169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: e8a236b9-6696-4cc5-9cd3-c0784a5f9df4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:38.794740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.795222 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.795661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.796962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:38.797528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:38.797960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:38.813814 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 HTTP/1.1 Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:38.821113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.822727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'e8a236b9-6696-4cc5-9cd3-c0784a5f9df4'} Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:38.823623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. Oct 04 05:49:38.825204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:38.826593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:38.826593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0fa31386-189f-420b-a478-d419726caf09 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4" status: 404 len: 111 microversion: 2.1 time: 0.033954 Oct 04 05:49:38.826593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 513/998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:38 2022] GET /compute/v2.1/servers/e8a236b9-6696-4cc5-9cd3-c0784a5f9df4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:39.511284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:39.512047 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:39.520462 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:39.521304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:39.522027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:39.523529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:39.524178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:39.524796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:39.557451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:39.559205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:39.566938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:39.567441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:39.567883 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:39.568330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:39.569062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:39.569669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:39.570823 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:39.571037 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:39.571826 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:39.572423 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:39.648650 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:39.664089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-81a87af7-1c0a-4ced-9bad-460b3129a3d9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.154206 Oct 04 05:49:39.664089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 486/999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:39 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:39.755010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:39.775234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:39.777207 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:39.791588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-017f8d96-c870-4a1e-99b1-131361ea8e4f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.238750 Oct 04 05:49:39.802564 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 514/1000] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:39 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:40.163482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:40.163996 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:40.170264 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.175641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.175641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.175641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.175641 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.175982 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.188744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c HTTP/1.1 Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:40.192126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.193819 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'edc3ace6-a575-4b82-8b82-a578d13bb43c'} Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:40.194778 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.196287 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.198712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:40.204198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2c62a7e5-b1af-43dd-a357-611bc1d243f6 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 404 len: 111 microversion: 2.1 time: 0.040214 Oct 04 05:49:40.204198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 487/1001] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:40 2022] DELETE /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:40.209166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:40.209851 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: edc3ace6-a575-4b82-8b82-a578d13bb43c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:40.216458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.216952 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.217856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.218692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.219278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.219743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.234935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c HTTP/1.1 Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:40.236634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.238339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'edc3ace6-a575-4b82-8b82-a578d13bb43c'} Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:40.239240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. Oct 04 05:49:40.240832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.242260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance edc3ace6-a575-4b82-8b82-a578d13bb43c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:40.242260 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8de3c7cf-42c9-4948-a865-be8a4b83bbbf tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c" status: 404 len: 111 microversion: 2.1 time: 0.034818 Oct 04 05:49:40.244796 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 515/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:40 2022] GET /compute/v2.1/servers/edc3ace6-a575-4b82-8b82-a578d13bb43c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:40.252035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:40.252748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:40.261870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.267470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.267470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.267470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.267470 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.267880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.281876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 HTTP/1.1 Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:40.283747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.285522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'afc490d5-7739-416e-8f18-375de3166471'} Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:40.296953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.298871 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.300468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:40.300468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-83fd68ab-9394-473e-99b7-41cf1ca562ee tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 404 len: 111 microversion: 2.1 time: 0.038546 Oct 04 05:49:40.300468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 488/1003] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:40 2022] DELETE /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:40.308080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:40.308562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: afc490d5-7739-416e-8f18-375de3166471] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:40.315963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.316475 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.316909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.317604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.318052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.318701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.337248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 HTTP/1.1 Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:40.338886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.340338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'afc490d5-7739-416e-8f18-375de3166471'} Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:40.348393 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. Oct 04 05:49:40.350566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:40.351896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance afc490d5-7739-416e-8f18-375de3166471 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:40.351896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-df54b8e1-3ee0-4667-a7a1-c5f1530bd384 tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471" status: 404 len: 111 microversion: 2.1 time: 0.044813 Oct 04 05:49:40.351896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 516/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:40 2022] GET /compute/v2.1/servers/afc490d5-7739-416e-8f18-375de3166471 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:40.687089 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:40.688291 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:40.695583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.697218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.697218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.697218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.697697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.698080 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.731496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.731496 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.731893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.731993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:40.776341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:40.784861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-44d2ae36-f562-4e60-895f-1930fc167b1f tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.101632 Oct 04 05:49:40.785469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 489/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:40 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:40.817663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:40.818346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:40.825523 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.826112 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.826793 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.827504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:40.827960 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:40.828546 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:40.983972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:40.992627 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:40.994071 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:40.995274 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0898f5d5-e5f8-4aeb-9431-98a36a0b3e7f tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.182238 Oct 04 05:49:40.995825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 517/1006] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:40 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:41.808448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:41.808981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:41.817022 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:41.817749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:41.818421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:41.819372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:41.819988 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:41.820760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:41.853378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:41.853853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:41.854329 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:41.854776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:41.897878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:41.906214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6dd43ac9-61a5-4fe2-9f57-74c0346e8995 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.101789 Oct 04 05:49:41.906791 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 490/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:41 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:42.021716 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:42.023062 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:42.031836 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:42.032595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:42.033035 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:42.033746 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:42.034441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:42.035091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:42.216747 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:42.225912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:42.227477 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:42.228827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-06bb8b44-be73-43d7-8880-b5898c310062 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.211980 Oct 04 05:49:42.229365 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 518/1008] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:42 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:42.928866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:42.929466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:42.935970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:42.936442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:42.937356 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:42.938038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:42.938941 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:42.939378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:42.980183 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:42.980661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:42.981092 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:42.981543 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:43.023855 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:43.032039 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5a9cf470-28bb-4ac3-a787-9188634f7017 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.106976 Oct 04 05:49:43.033188 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 491/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:42 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:43.255339 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:43.255915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:43.262294 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:43.262774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:43.263210 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:43.263896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:43.264345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:43.264768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:43.401834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:43.410638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:43.412116 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:43.413263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-36843e7c-4220-4d32-9938-2b09929b5934 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.161908 Oct 04 05:49:43.413910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 519/1010] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:43 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:49:44.054993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:44.055518 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:44.061949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.062465 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.062920 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.063605 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.064056 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.064484 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.096658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.097139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.097574 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.098026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:44.144946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:44.154125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7c9cf89a-7afa-4482-a61d-7401144db490 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.103011 Oct 04 05:49:44.155546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 492/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:44 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:44.443295 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:44.443957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:44.451347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.451881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.452320 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.453752 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.454235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.454725 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.617432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:44.628290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:44.629726 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:44.630915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2dc5869b-a7cd-494a-b3a2-eb3dda2f052b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.193051 Oct 04 05:49:44.646314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 520/1012] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:44 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:44.840332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:44.840916 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:44.847441 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.848318 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.848751 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.850934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.851404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.856875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.866833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a HTTP/1.1 Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:44.869093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.870523 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '71aa646b-022b-46dc-a362-fe7d63d90f5a'} Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:44.871498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.872809 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.874081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:44.874081 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4022a1e2-5881-43ac-a410-b46ce5bbb36c tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 404 len: 111 microversion: 2.1 time: 0.034627 Oct 04 05:49:44.875885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 493/1013] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:44 2022] DELETE /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:44.888296 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:44.888931 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] [instance: 71aa646b-022b-46dc-a362-fe7d63d90f5a] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:44.916816 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.920312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.920312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.920312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:44.920312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:44.920705 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:44.942932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] HTTP exception thrown: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Request method failure captured: Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a HTTP/1.1 Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZkczoDJ45NQf0UXP-zbdnH4iEQtNaxXaLtIHZV2c3CBEjsfyBGAfJIpC1vSIKBunPDA-CXW6OQGm7ErXZawjJZXTauK5qtxDRoNgmYQe1ar7goLwUTehk6s16fDMIwPrjuSR7j2PIdBBDatfte26fTjTOUVMukZnWy-sAQwk8NGc Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:44.955491 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7b850d4b5df4a4e93720cb855add44f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7b850d4b5df4a4e93720cb855add44f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7b850d4b5df4a4e93720cb855add44f"}]}] Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: f7b850d4b5df4a4e93720cb855add44f Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-496976470 Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: c66c7ddbf18d4f1fb8c890f548031f40 Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeNegativeTest-496976470-project Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.956981 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '71aa646b-022b-46dc-a362-fe7d63d90f5a'} Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:44.957765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. Oct 04 05:49:44.959689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:44.961337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] Returning 404 to user: Instance 71aa646b-022b-46dc-a362-fe7d63d90f5a could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:44.961337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-03954782-e78b-42c8-92b7-25da9223d71a tempest-AttachVolumeNegativeTest-496976470 tempest-AttachVolumeNegativeTest-496976470-project] 10.222.0.26 "GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a" status: 404 len: 111 microversion: 2.1 time: 0.080312 Oct 04 05:49:44.961337 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 521/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:44 2022] GET /compute/v2.1/servers/71aa646b-022b-46dc-a362-fe7d63d90f5a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:45.178657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:45.179256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:45.189428 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:45.190127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:45.191025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:45.191924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:45.192520 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:45.193088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:45.229293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:45.230025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:45.230661 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:45.231106 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lazy-loading 'fault' on Instance uuid 05a0814e-8898-4c71-87fc-1ced0aa84ba4 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:49:45.281535 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '537981b1b3a14cb4b10f336ef0362358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efd5ee13f094656992497528d761f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:45.285388 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1cb40a0f-c43d-448d-b083-09314598f959 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 200 len: 1327 microversion: 2.1 time: 0.110628 Oct 04 05:49:45.286114 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 494/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:45 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:49:45.659022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:45.663165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:45.666432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:45.666916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:45.667354 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:45.668054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:45.668534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:45.668957 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:45.904502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:45.912623 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:45.914303 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:45.915596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e883b35f-de82-4da7-bed9-dadf2ad39a33 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.261821 Oct 04 05:49:45.916533 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 522/1016] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:45 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:46.309231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:46.309785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:46.317163 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:46.317643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:46.318078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:46.318790 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:46.319240 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:46.319664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:46.332846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] HTTP exception thrown: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Request method failure captured: Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 HTTP/1.1 Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8ffGYYGtFzyvibJ1Umqev0w65ywMWcJENp1SwNE9oYTfzsLvi9iRkE-fODBeFnAzEh6mPFuR7Wv3MsiC7x4R5Gq4M5moPOIkfp9n8bbPILsBS0INCw4mYxIs6PZ0X7EWDCEmXK9mb-EBBM7baXFo-U0W2iu012GGOYfPj5uC9Km1oo Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:46.338064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7efd5ee13f094656992497528d761f2c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7efd5ee13f094656992497528d761f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}] Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 537981b1b3a14cb4b10f336ef0362358 Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:46.339768 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '05a0814e-8898-4c71-87fc-1ced0aa84ba4'} Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:46.340732 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:46.342321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:46.343703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Returning 404 to user: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:46.343703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9e5ce63b-bd14-4af7-a479-92cad6fd0f06 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 404 len: 111 microversion: 2.1 time: 0.030807 Oct 04 05:49:46.343703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 495/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:46 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:46.344885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-635832c3-aeb5-43ed-a1a6-04490a557fc2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '.version_select at 0x7f04865c3d30>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:46.463331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-635832c3-aeb5-43ed-a1a6-04490a557fc2 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192253945" status: 202 len: 0 microversion: 2.1 time: 0.122303 Oct 04 05:49:46.468618 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 523/1018] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 4 05:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192253945 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:49:46.941532 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:46.942161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:46.948704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:46.949354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:46.949852 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:46.951035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:46.951815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:46.952964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:46.969050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=100 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:49:47.204171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:47.213332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:47.215108 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:47.216485 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f64addc2-697e-476e-8d3e-82b43737ef96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.278955 Oct 04 05:49:47.217190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 496/1019] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:46 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:48.242932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:48.243632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:48.250099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:48.250670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:48.254197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:48.254197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:48.254197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:48.254197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:48.393673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:48.402505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:48.404104 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:48.406010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-885ab5b9-ee07-4cc2-91eb-bb9a3b90d3db tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.166892 Oct 04 05:49:48.406704 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 524/1020] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:48 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:49.357587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-9c9edbf1-2a53-4ccb-a483-2da6ec3fd659 req-527a4c00-7fd3-41c8-9293-3352024e99fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "name": "network-vif-plugged", "status": "completed", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:49.367935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-9c9edbf1-2a53-4ccb-a483-2da6ec3fd659 req-527a4c00-7fd3-41c8-9293-3352024e99fb service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:49.368412 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-9c9edbf1-2a53-4ccb-a483-2da6ec3fd659 req-527a4c00-7fd3-41c8-9293-3352024e99fb service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:49.369419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-9c9edbf1-2a53-4ccb-a483-2da6ec3fd659 req-527a4c00-7fd3-41c8-9293-3352024e99fb service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:49.380737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-9c9edbf1-2a53-4ccb-a483-2da6ec3fd659 req-527a4c00-7fd3-41c8-9293-3352024e99fb service nova] Creating event network-vif-plugged:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:49:49.385865 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-9c9edbf1-2a53-4ccb-a483-2da6ec3fd659 req-527a4c00-7fd3-41c8-9293-3352024e99fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032064 Oct 04 05:49:49.389403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 497/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:49:49.432932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:49.433800 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:49.440187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:49.440941 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:49.441364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:49.448870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:49.449609 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:49.465710 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:49.631122 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:49.649451 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:49.651350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:49.653204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-993a818a-dd10-4d4f-b8a2-5915adc98de9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.224231 Oct 04 05:49:49.667681 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 525/1022] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:49 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:49.966595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:49.979525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:49.979525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:49.979525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:49.979525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:49.980038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:49.980038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:49.980038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:49.990200 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] HTTP exception thrown: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Request method failure captured: Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 HTTP/1.1 Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8ffGYYGtFzyvibJ1Umqev0w65ywMWcJENp1SwNE9oYTfzsLvi9iRkE-fODBeFnAzEh6mPFuR7Wv3MsiC7x4R5Gq4M5moPOIkfp9n8bbPILsBS0INCw4mYxIs6PZ0X7EWDCEmXK9mb-EBBM7baXFo-U0W2iu012GGOYfPj5uC9Km1oo Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:49.991868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7efd5ee13f094656992497528d761f2c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7efd5ee13f094656992497528d761f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}] Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 537981b1b3a14cb4b10f336ef0362358 Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:49.993539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '05a0814e-8898-4c71-87fc-1ced0aa84ba4'} Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:49.994505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:49.996015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:49.997411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Returning 404 to user: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:49.997411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dfc998e8-9971-46be-89e0-9265c7356970 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 404 len: 111 microversion: 2.1 time: 0.031082 Oct 04 05:49:49.997411 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 498/1023] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:49 2022] DELETE /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:50.002321 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:50.002942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: 05a0814e-8898-4c71-87fc-1ced0aa84ba4] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:50.008894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:50.009458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:50.009809 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:50.010543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:50.011004 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:50.011436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:50.025415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] HTTP exception thrown: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Request method failure captured: Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 HTTP/1.1 Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8ffGYYGtFzyvibJ1Umqev0w65ywMWcJENp1SwNE9oYTfzsLvi9iRkE-fODBeFnAzEh6mPFuR7Wv3MsiC7x4R5Gq4M5moPOIkfp9n8bbPILsBS0INCw4mYxIs6PZ0X7EWDCEmXK9mb-EBBM7baXFo-U0W2iu012GGOYfPj5uC9Km1oo Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:50.027055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7efd5ee13f094656992497528d761f2c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7efd5ee13f094656992497528d761f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}] Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 537981b1b3a14cb4b10f336ef0362358 Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:50.028655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '05a0814e-8898-4c71-87fc-1ced0aa84ba4'} Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:50.029558 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. Oct 04 05:49:50.031137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:50.032345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Returning 404 to user: Instance 05a0814e-8898-4c71-87fc-1ced0aa84ba4 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:50.032345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a9d0eb95-acec-43f3-aadf-1596f00dc6b3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4" status: 404 len: 111 microversion: 2.1 time: 0.030564 Oct 04 05:49:50.032345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 526/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:49 2022] GET /compute/v2.1/servers/05a0814e-8898-4c71-87fc-1ced0aa84ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:50.942328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:50.942328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:50.942328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:50.942328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:50.944627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:50.944627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:50.944627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:50.944627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:50.944986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:50.944986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:50.945173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:50.945173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-06cec577-41e2-4184-84eb-5cbfc35a566a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.159984 Oct 04 05:49:50.945173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 499/1025] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:50 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:51.966328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:51.966937 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:51.973685 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:51.974196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:51.974645 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:51.975329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:51.975791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:51.976208 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:52.118994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:52.129264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:52.130983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:52.132198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-016da3e0-a410-4ea9-96d4-92f9e14e1e69 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1728 microversion: 2.20 time: 0.170038 Oct 04 05:49:52.133091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 527/1026] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:51 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:52.388946 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:52.389455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:52.396134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:52.396672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:52.397061 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:52.397754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:52.398308 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:52.398729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:52.412673 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] HTTP exception thrown: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Request method failure captured: Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 HTTP/1.1 Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8ffGYYGtFzyvibJ1Umqev0w65ywMWcJENp1SwNE9oYTfzsLvi9iRkE-fODBeFnAzEh6mPFuR7Wv3MsiC7x4R5Gq4M5moPOIkfp9n8bbPILsBS0INCw4mYxIs6PZ0X7EWDCEmXK9mb-EBBM7baXFo-U0W2iu012GGOYfPj5uC9Km1oo Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:49:52.414300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7efd5ee13f094656992497528d761f2c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7efd5ee13f094656992497528d761f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}] Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 537981b1b3a14cb4b10f336ef0362358 Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.415935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'fb8f1069-3555-4673-a945-1e45b7a35999'} Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:52.416804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.418095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.419956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Returning 404 to user: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:52.419956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-278814d3-30e0-4436-b790-d9c5dff47ba3 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 404 len: 111 microversion: 2.1 time: 0.030621 Oct 04 05:49:52.419956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 500/1027] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:49:52 2022] DELETE /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:52.429804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:52.429804 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] [instance: fb8f1069-3555-4673-a945-1e45b7a35999] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:52.434983 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:52.435480 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:52.435914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:52.437945 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:52.438440 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:52.438878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:52.453722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] HTTP exception thrown: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Request method failure captured: Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 HTTP/1.1 Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8ffGYYGtFzyvibJ1Umqev0w65ywMWcJENp1SwNE9oYTfzsLvi9iRkE-fODBeFnAzEh6mPFuR7Wv3MsiC7x4R5Gq4M5moPOIkfp9n8bbPILsBS0INCw4mYxIs6PZ0X7EWDCEmXK9mb-EBBM7baXFo-U0W2iu012GGOYfPj5uC9Km1oo Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:49:52.455311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7efd5ee13f094656992497528d761f2c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7efd5ee13f094656992497528d761f2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7efd5ee13f094656992497528d761f2c"}]}] Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 7efd5ee13f094656992497528d761f2c Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-964169461 Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 537981b1b3a14cb4b10f336ef0362358 Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeTestJSON-964169461-project Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.456947 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'fb8f1069-3555-4673-a945-1e45b7a35999'} Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:49:52.457834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. Oct 04 05:49:52.466900 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:49:52.468562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] Returning 404 to user: Instance fb8f1069-3555-4673-a945-1e45b7a35999 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:49:52.468562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-42b7b06d-156d-4605-be53-4f0d1e9446b9 tempest-AttachVolumeTestJSON-964169461 tempest-AttachVolumeTestJSON-964169461-project] 10.222.0.26 "GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999" status: 404 len: 111 microversion: 2.1 time: 0.036558 Oct 04 05:49:52.468562 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 528/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:49:52 2022] GET /compute/v2.1/servers/fb8f1069-3555-4673-a945-1e45b7a35999 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:49:53.157430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:53.158232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:49:53.165547 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:53.166388 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:53.170385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:53.170385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:49:53.170385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:49:53.170385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:49:53.375225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:53.384567 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:53.385998 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:49:53.387226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-17b7ef0f-c780-4392-b366-5c43a80318bc tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1715 microversion: 2.20 time: 0.234131 Oct 04 05:49:53.394760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 501/1029] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:49:53 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1715 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:49:58.637817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d3412f8b-93b5-4b49-acca-16a2d8b35985 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Action: 'create', calling method: .version_select at 0x7f04865ecc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1653838267"}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:49:59.382401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d3412f8b-93b5-4b49-acca-16a2d8b35985 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.866897 Oct 04 05:49:59.382856 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 529/1030] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 4 05:49:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 868 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 05:49:59.395957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fa28adb1-f61b-469a-a3c7-3c03472615fc tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865931f0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:49:59.445642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fa28adb1-f61b-469a-a3c7-3c03472615fc tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 200 len: 345 microversion: 2.1 time: 0.053349 Oct 04 05:49:59.446445 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 502/1031] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:49:59 2022] GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:00.461250 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f7f47d72-f8be-4d79-9f0e-f6a08162b22b tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04866e33a0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:00.509888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f7f47d72-f8be-4d79-9f0e-f6a08162b22b tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 200 len: 346 microversion: 2.1 time: 0.053355 Oct 04 05:50:00.510659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 530/1032] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:00 2022] GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:00.524012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-786acc21-4743-49d1-8e5e-14c8e644806f tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Action: 'create', calling method: .version_select at 0x7f04863e2f70>, body: {"snapshot": {"volume_id": "377a1941-125c-4fcc-b930-dbd1e49cccb1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1392303328"}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:50:00.993447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-786acc21-4743-49d1-8e5e-14c8e644806f tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.473075 Oct 04 05:50:00.994160 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 503/1033] 10.222.0.26 () {60 vars in 1162 bytes} [Tue Oct 4 05:50:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:01.005874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9b43bd8d-ebf9-49a8-8f4b-4f93e491ab13 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865d1ca0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:01.034961 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9b43bd8d-ebf9-49a8-8f4b-4f93e491ab13 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 200 len: 287 microversion: 2.1 time: 0.033508 Oct 04 05:50:01.035548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 531/1034] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:01 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:01.046820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e5cfadb4-7c55-447d-8421-8819974df101 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865b6790>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:01.079285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e5cfadb4-7c55-447d-8421-8819974df101 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036200 Oct 04 05:50:01.079873 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 504/1035] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 4 05:50:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:01.090924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6e1fd941-545c-4ad9-825e-67cf8bcddbc8 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865ad310>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:01.133737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6e1fd941-545c-4ad9-825e-67cf8bcddbc8 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 200 len: 287 microversion: 2.1 time: 0.046666 Oct 04 05:50:01.143248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 532/1036] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:01 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:02.147815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4cf66b12-4544-47ff-bf4e-34dce1a169dc tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865b6e50>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:02.178953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4cf66b12-4544-47ff-bf4e-34dce1a169dc tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 200 len: 287 microversion: 2.1 time: 0.036343 Oct 04 05:50:02.179609 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 505/1037] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:02 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:03.189840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:03.191227 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=67 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:03.195936 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-2d279b0a-ea87-4e39-a2d4-245c3586ba4b tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865ecaf0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:03.234972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-2d279b0a-ea87-4e39-a2d4-245c3586ba4b tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 200 len: 287 microversion: 2.1 time: 0.044259 Oct 04 05:50:03.234972 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 533/1038] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:03 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:04.244737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f9dc3439-db7e-4777-88b2-129b4b7e8ee3 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f048636a550>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:04.252144 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=69 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:04.253021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=22 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:04.285454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f9dc3439-db7e-4777-88b2-129b4b7e8ee3 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 200 len: 288 microversion: 2.1 time: 0.044499 Oct 04 05:50:04.286769 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 506/1039] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:04 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:04.299197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-032e934b-a94a-458b-92eb-db8066909c96 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865559d0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:04.447432 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-032e934b-a94a-458b-92eb-db8066909c96 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 202 len: 0 microversion: 2.1 time: 0.153212 Oct 04 05:50:04.448126 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 534/1040] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 4 05:50:04 2022] DELETE /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:50:04.457056 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0f837071-d219-48dd-9fea-82d11fefb1c6 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04863b5c10>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:04.504688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0f837071-d219-48dd-9fea-82d11fefb1c6 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 200 len: 287 microversion: 2.1 time: 0.051764 Oct 04 05:50:04.506474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 507/1041] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:04 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:05.518578 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5d32c2cf-de7b-4737-8e56-715481569ab5 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f0489dbfa60>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:05.543659 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-5d32c2cf-de7b-4737-8e56-715481569ab5 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] HTTP exception thrown: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5d32c2cf-de7b-4737-8e56-715481569ab5 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Request method failure captured: Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c HTTP/1.1 Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8mGibwZzKy0qgN4-f3aS65PEa_6UkJ4jUDzzRSTRgB3hICfJ4AaBUdfHPWXDVD3bBfe3sJ7e3nOULmB7xLCAz5N9myDv30VKXqh3qWp0e33loUK8_vEIMPc35vcnN1wC1ZwzsqsSAArX4vRGOjYjtL5Wo7EZtlLc0GS78oGRnOMX6s Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:50:05.547496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b43ccfbf77d42dcbab0b85aceeb4324", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}] Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: dc6572065fca458299c5485f5ae28661 Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '513df0ae-7bbf-4754-a175-72c0212b9b3c'} Oct 04 05:50:05.548901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. (HTTP 404) (Request-ID: req-481b1bea-6ff5-4cfb-a195-857adbe06522) Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.549788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:50:05.551072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 05:50:05.552211 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5d32c2cf-de7b-4737-8e56-715481569ab5 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Returning 404 to user: Snapshot 513df0ae-7bbf-4754-a175-72c0212b9b3c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:05.553667 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5d32c2cf-de7b-4737-8e56-715481569ab5 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c" status: 404 len: 111 microversion: 2.1 time: 0.034760 Oct 04 05:50:05.554737 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 535/1042] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:50:05 2022] GET /compute/v2.1/os-snapshots/513df0ae-7bbf-4754-a175-72c0212b9b3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:50:05.557565 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-daec41cb-e63d-424a-b28d-7352541c187a tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f048663d8b0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:05.787439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-daec41cb-e63d-424a-b28d-7352541c187a tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 202 len: 0 microversion: 2.1 time: 0.233563 Oct 04 05:50:05.788676 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 508/1043] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:50:05 2022] DELETE /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:50:05.797010 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-74fc73db-5ba7-43ec-b725-5e6139ddd588 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f0486497ca0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:05.845052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-74fc73db-5ba7-43ec-b725-5e6139ddd588 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 200 len: 345 microversion: 2.1 time: 0.052569 Oct 04 05:50:05.845643 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 536/1044] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:05 2022] GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:06.860285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-17fb03be-df62-4ee1-8bce-75afaa520421 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04866e5dc0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:06.894337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-17fb03be-df62-4ee1-8bce-75afaa520421 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] HTTP exception thrown: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-17fb03be-df62-4ee1-8bce-75afaa520421 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Request method failure captured: Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 HTTP/1.1 Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8mGibwZzKy0qgN4-f3aS65PEa_6UkJ4jUDzzRSTRgB3hICfJ4AaBUdfHPWXDVD3bBfe3sJ7e3nOULmB7xLCAz5N9myDv30VKXqh3qWp0e33loUK8_vEIMPc35vcnN1wC1ZwzsqsSAArX4vRGOjYjtL5Wo7EZtlLc0GS78oGRnOMX6s Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:50:06.897762 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b43ccfbf77d42dcbab0b85aceeb4324", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}] Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: dc6572065fca458299c5485f5ae28661 Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '377a1941-125c-4fcc-b930-dbd1e49cccb1'} Oct 04 05:50:06.899483 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. (HTTP 404) (Request-ID: req-f1662dc3-0b01-4adb-968a-03bfddcf2329) Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.900498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:50:06.901960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 05:50:06.903243 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-17fb03be-df62-4ee1-8bce-75afaa520421 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Returning 404 to user: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-17fb03be-df62-4ee1-8bce-75afaa520421 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 404 len: 109 microversion: 2.1 time: 0.047284 Oct 04 05:50:06.905506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 509/1045] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:06 2022] GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:50:06.918507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-580b1119-ea45-4f74-9e70-ba701cf159c1 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04865d1ee0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:06.947140 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-580b1119-ea45-4f74-9e70-ba701cf159c1 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] HTTP exception thrown: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-580b1119-ea45-4f74-9e70-ba701cf159c1 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Request method failure captured: Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: DELETE /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 HTTP/1.1 Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8mGibwZzKy0qgN4-f3aS65PEa_6UkJ4jUDzzRSTRgB3hICfJ4AaBUdfHPWXDVD3bBfe3sJ7e3nOULmB7xLCAz5N9myDv30VKXqh3qWp0e33loUK8_vEIMPc35vcnN1wC1ZwzsqsSAArX4vRGOjYjtL5Wo7EZtlLc0GS78oGRnOMX6s Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:50:06.949663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b43ccfbf77d42dcbab0b85aceeb4324", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}] Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: dc6572065fca458299c5485f5ae28661 Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '377a1941-125c-4fcc-b930-dbd1e49cccb1'} Oct 04 05:50:06.951405 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. (HTTP 404) (Request-ID: req-388c220d-cdcf-48d3-a6a8-bf3cb6c96e08) Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.952333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 05:50:06.953728 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 05:50:06.955161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-580b1119-ea45-4f74-9e70-ba701cf159c1 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Returning 404 to user: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-580b1119-ea45-4f74-9e70-ba701cf159c1 tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 404 len: 109 microversion: 2.1 time: 0.037465 Oct 04 05:50:06.956560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 537/1046] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:50:06 2022] DELETE /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:50:06.960967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-08b4bada-b7ef-4232-a7af-fcdd6e0e463d tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Calling method '.version_select at 0x7f04863b5f70>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:06.989199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-08b4bada-b7ef-4232-a7af-fcdd6e0e463d tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] HTTP exception thrown: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-08b4bada-b7ef-4232-a7af-fcdd6e0e463d tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Request method failure captured: Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 HTTP/1.1 Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8mGibwZzKy0qgN4-f3aS65PEa_6UkJ4jUDzzRSTRgB3hICfJ4AaBUdfHPWXDVD3bBfe3sJ7e3nOULmB7xLCAz5N9myDv30VKXqh3qWp0e33loUK8_vEIMPc35vcnN1wC1ZwzsqsSAArX4vRGOjYjtL5Wo7EZtlLc0GS78oGRnOMX6s Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:50:06.991238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b43ccfbf77d42dcbab0b85aceeb4324", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b43ccfbf77d42dcbab0b85aceeb4324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b43ccfbf77d42dcbab0b85aceeb4324"}]}] Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 7b43ccfbf77d42dcbab0b85aceeb4324 Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-121208391 Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: dc6572065fca458299c5485f5ae28661 Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-121208391-project Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '377a1941-125c-4fcc-b930-dbd1e49cccb1'} Oct 04 05:50:06.992872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. (HTTP 404) (Request-ID: req-2e115ae6-5b7f-49f4-b5be-f2067ce6832a) Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:06.996889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:50:06.998320 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 05:50:07.000285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-08b4bada-b7ef-4232-a7af-fcdd6e0e463d tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] Returning 404 to user: Volume 377a1941-125c-4fcc-b930-dbd1e49cccb1 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-08b4bada-b7ef-4232-a7af-fcdd6e0e463d tempest-VolumesSnapshotsTestJSON-121208391 tempest-VolumesSnapshotsTestJSON-121208391-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1" status: 404 len: 109 microversion: 2.1 time: 0.036357 Oct 04 05:50:07.001669 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 510/1047] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:06 2022] GET /compute/v2.1/os-volumes/377a1941-125c-4fcc-b930-dbd1e49cccb1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:50:32.711621 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:32.714713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:32.721054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:32.721584 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:32.722092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:32.722844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:32.723336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:32.723803 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:32.754029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cb38c430-f848-4176-afcc-93750ea5eca0 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047271 Oct 04 05:50:32.754669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 538/1048] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 4 05:50:32 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:50:32.824558 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:32.825134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:32.833600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:32.834084 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:32.834554 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:32.835251 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:32.835703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:32.836125 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:32.861034 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:50:33.141821 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ce686fc1-910a-413e-bc6a-c0b081494bab tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 204 len: 0 microversion: 2.20 time: 0.321694 Oct 04 05:50:33.142664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 511/1049] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 05:50:32 2022] DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 05:50:33.151031 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:33.151658 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:33.159215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:33.159697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:33.160185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:33.161067 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:33.161536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:33.162041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:33.295042 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:33.303681 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:33.305113 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:33.306285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a4d2d508-18cc-4ca0-b1de-452b84ca4f37 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.159391 Oct 04 05:50:33.306832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 539/1050] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:33 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:34.332154 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:34.332792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:34.339754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:34.340232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:34.340688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:34.341385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:34.341830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:34.342288 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:34.477515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:34.486322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:34.488468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:34.489624 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-13f32c37-af87-4be6-baeb-bda2c6a23d5c tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.161931 Oct 04 05:50:34.490219 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 512/1051] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:34 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:35.516290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:35.516894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:35.523948 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:35.532464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:35.532464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:35.532464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:35.532464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:35.533795 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:35.683998 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:35.701547 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:35.703078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:35.704668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-babc6e0e-db01-4c8f-915c-f06f5fd4089a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1721 microversion: 2.20 time: 0.192499 Oct 04 05:50:35.705225 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 540/1052] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:35 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 05:50:35.920890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-57550dc2-ee93-4d4c-80e7-560720705515 req-b55c13d6-4572-4dfa-a6d9-730a8e67210f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac56e7ba-43ea-4595-8551-352767e8e8fe", "name": "network-vif-deleted", "tag": "6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:50:35.934177 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-57550dc2-ee93-4d4c-80e7-560720705515 req-b55c13d6-4572-4dfa-a6d9-730a8e67210f service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:35.934791 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-57550dc2-ee93-4d4c-80e7-560720705515 req-b55c13d6-4572-4dfa-a6d9-730a8e67210f service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:35.935486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-57550dc2-ee93-4d4c-80e7-560720705515 req-b55c13d6-4572-4dfa-a6d9-730a8e67210f service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:35.948796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-57550dc2-ee93-4d4c-80e7-560720705515 req-b55c13d6-4572-4dfa-a6d9-730a8e67210f service nova] Creating event network-vif-deleted:6395b8ca-5889-4abb-b6e4-cd8c5ca5c58d for instance ac56e7ba-43ea-4595-8551-352767e8e8fe on hv-cinder-84914 Oct 04 05:50:35.955432 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-57550dc2-ee93-4d4c-80e7-560720705515 req-b55c13d6-4572-4dfa-a6d9-730a8e67210f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038197 Oct 04 05:50:35.956172 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 513/1053] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:36.729134 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:36.729733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:36.735919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:36.736400 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:36.736830 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:36.737550 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:36.737996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:36.738570 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:36.800460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:36.808918 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:36.810428 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:36.811577 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-65ef85e7-9b42-4beb-9409-d1f172272eb8 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1365 microversion: 2.20 time: 0.086612 Oct 04 05:50:36.812124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 541/1054] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:36 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1365 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:37.838489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:37.839128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:37.845231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:37.845704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:37.846808 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:37.847499 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:37.847945 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:37.848364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:37.909588 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:37.917715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:37.919191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:37.920328 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8213dbb7-68fa-493d-8ef8-828d9bf01b65 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1365 microversion: 2.20 time: 0.086692 Oct 04 05:50:37.920893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 514/1055] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:37 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1365 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:38.197507 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:38.198052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:38.204456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.209044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.209044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.209044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.209044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.209442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.232439 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:50:38.494933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c6d6337b-c743-434b-a985-4804648adb64 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 204 len: 0 microversion: 2.1 time: 0.300885 Oct 04 05:50:38.495448 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 542/1056] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:50:38 2022] DELETE /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:50:38.504037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:38.504643 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:38.510811 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.511285 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.511718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.512403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.512853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.513275 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.646186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:38.654107 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0cbb22f9-c99f-4ce8-b947-b8437269b1f5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1576 microversion: 2.1 time: 0.154403 Oct 04 05:50:38.654864 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 515/1057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:38 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:38.946632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:38.947324 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:38.953382 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.953865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.954333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.955025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.955480 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.955909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.989427 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:38.989897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:38.990367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:38.990810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'fault' on Instance uuid ac56e7ba-43ea-4595-8551-352767e8e8fe {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:50:39.032861 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:39.041404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:39.042882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:39.044060 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-21f688f6-e6c6-4e21-b760-9487a6eccff9 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1370 microversion: 2.20 time: 0.101727 Oct 04 05:50:39.044617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 543/1058] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:38 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:39.676897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:39.677495 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:39.683729 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:39.684206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:39.684634 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:39.685322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:39.685767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:39.686205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:39.822502 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:39.830244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b37cae34-d2ca-4bf6-b93c-c219ebd19f2c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1576 microversion: 2.1 time: 0.157403 Oct 04 05:50:39.831537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 516/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:39 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:40.069610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:40.070916 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:40.077532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:40.078085 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:40.078617 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:40.079323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:40.079780 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:40.080212 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:40.112555 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:40.113043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:40.113479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:40.113923 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'fault' on Instance uuid ac56e7ba-43ea-4595-8551-352767e8e8fe {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:50:40.154002 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:40.162132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:40.163590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:40.164740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-07cf7150-68a6-4631-9379-8e03e346ad1a tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1370 microversion: 2.20 time: 0.099851 Oct 04 05:50:40.165294 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 544/1060] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:40 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:40.853755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:40.854412 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:40.860698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:40.861181 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:40.861619 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:40.862344 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:40.862800 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:40.863229 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:40.997454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:41.005237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7aa0a68d-52cc-4c75-954e-a3439031c64e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1576 microversion: 2.1 time: 0.155379 Oct 04 05:50:41.005805 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 517/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:40 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:41.189581 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:41.190899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:41.198232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:41.198720 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:41.199155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:41.199818 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:41.200265 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:41.200859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:41.232595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:41.233078 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:41.233521 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:41.233967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lazy-loading 'fault' on Instance uuid ac56e7ba-43ea-4595-8551-352767e8e8fe {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:50:41.276025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:41.284622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:41.287089 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1635c9c6cf4fb092c0f03a02e36174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636e6b38bf1d4736a38728488881e9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:41.287217 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3c1df173-8c45-43cf-8038-cc1a3100c77b tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 200 len: 1370 microversion: 2.20 time: 0.101594 Oct 04 05:50:41.287813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 545/1062] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:41 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 05:50:42.028371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:42.029607 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:42.037046 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:42.037727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:42.038359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:42.039237 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:42.039847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:42.040427 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:42.201767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:42.209793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d138b4f1-0cf6-419c-b466-27329c2041ec tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1576 microversion: 2.1 time: 0.185194 Oct 04 05:50:42.210618 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 518/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:42 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:42.312447 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:42.313284 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:42.320702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:42.321939 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:42.322426 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:42.323152 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:42.323671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:42.324106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:42.339810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] HTTP exception thrown: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Request method failure captured: Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe HTTP/1.1 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZ2tXfrhvPqIvgpWmVJ-eJY5DD4LGbDFuuFAQroHWY7RGDYL6oHqDulhQuzHc51SMilf_uVieeVwG0N93ioFUyoKt-vGfLscw6fGTeL4LSSicN__F9vbPNQckmJlhJNEh5D1t7ZbGiiU3S1ARv8YdsMzVvnoWcsf02iAr611xWILQ Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:50:42.341517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_636e6b38bf1d4736a38728488881e9d2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}] Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 6f1635c9c6cf4fb092c0f03a02e36174 Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:42.343066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'ac56e7ba-43ea-4595-8551-352767e8e8fe'} Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:42.344285 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:42.345620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:42.348699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Returning 404 to user: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:42.348699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-70de198a-e79b-441e-931a-db4ecd917cdd tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 404 len: 111 microversion: 2.20 time: 0.034764 Oct 04 05:50:42.353015 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ca006aab-16e7-4a53-a968-c23fd2dbdc96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '.version_select at 0x7f04865b6430>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:42.358241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 546/1064] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:42 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:50:42.440372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ca006aab-16e7-4a53-a968-c23fd2dbdc96 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592520745" status: 204 len: 0 microversion: 2.20 time: 0.091389 Oct 04 05:50:42.442506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 519/1065] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 4 05:50:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592520745 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 05:50:42.619083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-ee3ae536-9d9a-4e60-9e5f-daab11124891 req-95a040eb-ea55-46bc-9925-93d5ff511d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "517a5b7f-76e0-4888-8e50-c6972ee30554", "name": "network-vif-deleted", "tag": "3846f25e-2d58-45ca-827a-81e04bfd4146"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:50:42.634901 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-ee3ae536-9d9a-4e60-9e5f-daab11124891 req-95a040eb-ea55-46bc-9925-93d5ff511d4e service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:42.635206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-ee3ae536-9d9a-4e60-9e5f-daab11124891 req-95a040eb-ea55-46bc-9925-93d5ff511d4e service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:42.635676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-ee3ae536-9d9a-4e60-9e5f-daab11124891 req-95a040eb-ea55-46bc-9925-93d5ff511d4e service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:42.676106 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-ee3ae536-9d9a-4e60-9e5f-daab11124891 req-95a040eb-ea55-46bc-9925-93d5ff511d4e service nova] Creating event network-vif-deleted:3846f25e-2d58-45ca-827a-81e04bfd4146 for instance 517a5b7f-76e0-4888-8e50-c6972ee30554 on hv-cinder-84914 Oct 04 05:50:42.685082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-ee3ae536-9d9a-4e60-9e5f-daab11124891 req-95a040eb-ea55-46bc-9925-93d5ff511d4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075739 Oct 04 05:50:42.689464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 547/1066] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:43.237040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:43.238660 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:43.245782 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:43.246293 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:43.246755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:43.250792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:43.251533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:43.262959 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:43.339494 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:43.350938 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7b9c8b4c-d6e4-42b5-9db5-86527acf7542 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1225 microversion: 2.1 time: 0.121284 Oct 04 05:50:43.351550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 520/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:43 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:44.384056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:44.384864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:44.392502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:44.392837 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:44.393467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:44.394378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:44.394910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:44.395336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:44.428338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:44.428823 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:44.429258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:44.429699 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lazy-loading 'fault' on Instance uuid 517a5b7f-76e0-4888-8e50-c6972ee30554 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:50:44.490236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:44.499497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-97478061-fb79-4763-b774-fcceb78ebd9b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 200 len: 1184 microversion: 2.1 time: 0.119613 Oct 04 05:50:44.500833 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 548/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:44 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:45.112953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:45.113510 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:45.120248 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:45.120849 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:45.121170 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:45.121902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:45.122457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:45.123046 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:45.140038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] HTTP exception thrown: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Request method failure captured: Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe HTTP/1.1 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZ2tXfrhvPqIvgpWmVJ-eJY5DD4LGbDFuuFAQroHWY7RGDYL6oHqDulhQuzHc51SMilf_uVieeVwG0N93ioFUyoKt-vGfLscw6fGTeL4LSSicN__F9vbPNQckmJlhJNEh5D1t7ZbGiiU3S1ARv8YdsMzVvnoWcsf02iAr611xWILQ Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:50:45.142101 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_636e6b38bf1d4736a38728488881e9d2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}] Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 6f1635c9c6cf4fb092c0f03a02e36174 Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.144205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': 'ac56e7ba-43ea-4595-8551-352767e8e8fe'} Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:45.145057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.146668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.153351 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Returning 404 to user: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:45.153351 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-3ae643ee-d2a4-4082-bf87-16035bef4456 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 404 len: 111 microversion: 2.20 time: 0.035641 Oct 04 05:50:45.153351 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 521/1069] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 05:50:45 2022] DELETE /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:50:45.156985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:45.158283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: ac56e7ba-43ea-4595-8551-352767e8e8fe] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:45.166340 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:45.167831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:45.168739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:45.169616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:45.171054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:45.171686 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:45.187157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] HTTP exception thrown: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Request method failure captured: Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe HTTP/1.1 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZ2tXfrhvPqIvgpWmVJ-eJY5DD4LGbDFuuFAQroHWY7RGDYL6oHqDulhQuzHc51SMilf_uVieeVwG0N93ioFUyoKt-vGfLscw6fGTeL4LSSicN__F9vbPNQckmJlhJNEh5D1t7ZbGiiU3S1ARv8YdsMzVvnoWcsf02iAr611xWILQ Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:50:45.189259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_636e6b38bf1d4736a38728488881e9d2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}] Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 6f1635c9c6cf4fb092c0f03a02e36174 Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.191450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'ac56e7ba-43ea-4595-8551-352767e8e8fe'} Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:45.192494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. Oct 04 05:50:45.193722 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.194885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Returning 404 to user: Instance ac56e7ba-43ea-4595-8551-352767e8e8fe could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:45.194885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-094e4cee-1b61-4be8-a79a-e7be67e025c7 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe" status: 404 len: 111 microversion: 2.20 time: 0.042229 Oct 04 05:50:45.194885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 549/1070] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:45 2022] GET /compute/v2.1/servers/ac56e7ba-43ea-4595-8551-352767e8e8fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:50:45.523735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:45.524339 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:45.530513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:45.531405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:45.532098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:45.532867 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:45.533629 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:45.534304 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:45.552642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] HTTP exception thrown: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Request method failure captured: Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 HTTP/1.1 Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8j2XLetu_xQeSFC3ZJ8rJxQczD8pdMbXR-N9J4HutGwbTU487EhzxA_7w3LDC5MmzY0zBpDZPO9sjsItlt6kEYuz1UKPSXoV9L7njsmrXfL81d_uWyTJyMd6LGpaSb64zsatIYRJif9cOGm5ViiUxbfuZ2iC6fi-7HHWfCQB1QpJog Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:50:45.554472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_45a5869786d843fe9fb5cdb6b3596c2f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}] Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 0c0c0a25340a451b970cc3de8bc05806 Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:50:45.555973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '517a5b7f-76e0-4888-8e50-c6972ee30554'} Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:45.556758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:50:45.558003 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:45.570764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Returning 404 to user: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:45.570764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-aec1dee1-3dd9-4536-bdaf-7ae8e477b716 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 404 len: 111 microversion: 2.1 time: 0.040839 Oct 04 05:50:45.570764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 522/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:45 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:50:45.675905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1136607111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495012344", "security_groups": [{"name": "tempest-secgroup-smoke-1310825236"}], "block_device_mapping_v2": [{"uuid": "ea48232b-80b4-445a-8398-7b09f260b7c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79e2bf3e-1f66-495f-8ec9-26b178e13978"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:50:45.797232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] validate_networks() for [('79e2bf3e-1f66-495f-8ec9-26b178e13978', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:50:46.269882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:50:46.270306 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:50:46.270813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:50:46.271223 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:50:46.271634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:50:46.280598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:46.281088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:46.281519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:46.282282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:46.282765 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:46.283191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:46.300492 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:50:46.305590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for user 0c0c0a25340a451b970cc3de8bc05806 and project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:50:46.363232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:50:46.365381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea48232b-80b4-445a-8398-7b09f260b7c0',volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:50:46.784512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7fc22c98-a2f7-4f83-8b10-0d098c1ff8e3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.117740 Oct 04 05:50:46.785214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 550/1072] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:50:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 05:50:46.796135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7205445e-9796-4b35-9453-997335839b0f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:46.797383 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7205445e-9796-4b35-9453-997335839b0f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:46.869776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7205445e-9796-4b35-9453-997335839b0f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:46.878272 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7205445e-9796-4b35-9453-997335839b0f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1094 microversion: 2.1 time: 0.084632 Oct 04 05:50:46.890793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 523/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:46 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:47.901797 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:47.902430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:47.909029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:47.909567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:47.909998 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:47.910712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:47.911157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:47.911572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:47.980436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:47.988450 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9a8aed41-6722-4838-a16a-d92e6b8a5c7a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1144 microversion: 2.1 time: 0.090967 Oct 04 05:50:47.989204 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 551/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:47 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:49.012040 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:49.012592 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:49.020589 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:49.021073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:49.021514 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:49.022249 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:49.022713 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:49.023158 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:49.086587 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:49.094345 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d32eba5e-98a4-45d8-811b-a0ccd75982a1 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1192 microversion: 2.1 time: 0.086364 Oct 04 05:50:49.094906 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 524/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:49 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:50:49.716489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:49.717933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:49.727711 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:49.728592 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:49.729209 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:49.730108 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:49.730603 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:49.731034 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:49.746040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] HTTP exception thrown: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Request method failure captured: Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c HTTP/1.1 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8fZ2tXfrhvPqIvgpWmVJ-eJY5DD4LGbDFuuFAQroHWY7RGDYL6oHqDulhQuzHc51SMilf_uVieeVwG0N93ioFUyoKt-vGfLscw6fGTeL4LSSicN__F9vbPNQckmJlhJNEh5D1t7ZbGiiU3S1ARv8YdsMzVvnoWcsf02iAr611xWILQ Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:50:49.747385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_636e6b38bf1d4736a38728488881e9d2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}] Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 6f1635c9c6cf4fb092c0f03a02e36174 Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.749380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '73d72dc7-af42-4950-b7c2-3d617f22680c'} Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:49.750670 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.758330 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.760088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Returning 404 to user: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:49.760088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e1fd5f3f-eee2-4e14-9690-5d7227de9817 tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 404 len: 111 microversion: 2.20 time: 0.036505 Oct 04 05:50:49.760088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 552/1076] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 4 05:50:49 2022] DELETE /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:50:49.760419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:49.760419 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] [instance: 73d72dc7-af42-4950-b7c2-3d617f22680c] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:49.764341 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:49.765299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:49.765299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:49.765947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:49.766418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:49.766927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] HTTP exception thrown: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Request method failure captured: Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c HTTP/1.1 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8fZ2tXfrhvPqIvgpWmVJ-eJY5DD4LGbDFuuFAQroHWY7RGDYL6oHqDulhQuzHc51SMilf_uVieeVwG0N93ioFUyoKt-vGfLscw6fGTeL4LSSicN__F9vbPNQckmJlhJNEh5D1t7ZbGiiU3S1ARv8YdsMzVvnoWcsf02iAr611xWILQ Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:50:49.789684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_636e6b38bf1d4736a38728488881e9d2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/636e6b38bf1d4736a38728488881e9d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/636e6b38bf1d4736a38728488881e9d2"}]}] Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 636e6b38bf1d4736a38728488881e9d2 Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1915031324 Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 6f1635c9c6cf4fb092c0f03a02e36174 Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1915031324-project Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.791727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '73d72dc7-af42-4950-b7c2-3d617f22680c'} Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:50:49.792712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. Oct 04 05:50:49.794680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:50:49.796271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] Returning 404 to user: Instance 73d72dc7-af42-4950-b7c2-3d617f22680c could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:50:49.796271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ccfd75f2-9b40-4d7e-8409-dfb57afc1adb tempest-AttachVolumeShelveTestJSON-1915031324 tempest-AttachVolumeShelveTestJSON-1915031324-project] 10.222.0.26 "GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c" status: 404 len: 111 microversion: 2.20 time: 0.031378 Oct 04 05:50:49.796271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 525/1077] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 4 05:50:49 2022] GET /compute/v2.1/servers/73d72dc7-af42-4950-b7c2-3d617f22680c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 05:50:50.117267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:50.118041 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:50.124322 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:50.124946 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:50.125485 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:50.126431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:50.127257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:50.127757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:50.355929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:50.367587 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e3e3fa6c-05e5-40d9-8bc8-6ba6217a0e8c tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1278 microversion: 2.1 time: 0.254397 Oct 04 05:50:50.369189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 553/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:50 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:51.214203 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-e3817365-4c5e-4ba3-aff4-20164a2a0955 req-51bfe2d9-e215-44d3-8156-670f9503e003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7", "tag": "f35de6bd-faf9-47cd-8910-fb186f4a737c"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:50:51.238082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-e3817365-4c5e-4ba3-aff4-20164a2a0955 req-51bfe2d9-e215-44d3-8156-670f9503e003 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:51.239201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-e3817365-4c5e-4ba3-aff4-20164a2a0955 req-51bfe2d9-e215-44d3-8156-670f9503e003 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:51.239860 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-e3817365-4c5e-4ba3-aff4-20164a2a0955 req-51bfe2d9-e215-44d3-8156-670f9503e003 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:51.256665 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-e3817365-4c5e-4ba3-aff4-20164a2a0955 req-51bfe2d9-e215-44d3-8156-670f9503e003 service nova] Creating event network-changed:f35de6bd-faf9-47cd-8910-fb186f4a737c for instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 on hv-cinder-84914 Oct 04 05:50:51.262018 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-e3817365-4c5e-4ba3-aff4-20164a2a0955 req-51bfe2d9-e215-44d3-8156-670f9503e003 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058843 Oct 04 05:50:51.268373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 526/1079] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:51.395838 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:51.397216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:51.407572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:51.408904 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:51.409605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:51.410571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:51.411790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:51.412415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:51.648633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:51.652517 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:51.657124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-50dbac37-c503-4b46-8de4-8a73e3823988 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1278 microversion: 2.1 time: 0.266673 Oct 04 05:50:51.657676 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 554/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:51 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:52.683583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:52.684284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:52.703895 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:52.704392 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:52.708047 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:52.717025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:52.717717 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:52.718197 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:52.988471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:53.003868 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-014b5650-cb5b-4e4e-a371-94b579f81f2e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.324825 Oct 04 05:50:53.010617 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 527/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:52 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:54.047629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:54.047629 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:54.050762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:54.051255 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:54.051692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:54.052598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:54.052971 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:54.053429 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:54.214297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:54.222347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f042af5a-5315-43e8-b6ed-d20c759d83d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.198797 Oct 04 05:50:54.223038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 555/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:54 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:55.245253 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:55.245862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:55.252032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:55.252513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:55.252952 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:55.253640 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:55.255299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:55.255299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:55.415858 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:55.423770 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2914a613-e9c0-4a0c-bbf3-ca4d81e8376a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.182648 Oct 04 05:50:55.424337 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 528/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:55 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:56.447107 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:56.447827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:56.452351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:56.453522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:56.457789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:56.458496 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:56.459013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:56.460258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:56.460791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:56.461290 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:56.599001 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:56.606840 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-721cb65b-4ce7-4217-bfbe-b76a64dbe806 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.163972 Oct 04 05:50:56.607675 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 556/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:56 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:56.697343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-81973367-11bb-4846-b7fd-20b7acd4f882 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Action: 'create', calling method: .version_select at 0x7f04863b58b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1621295006", "metadata": {"Type": "work"}}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:50:56.873930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:50:57.427649 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-81973367-11bb-4846-b7fd-20b7acd4f882 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.897871 Oct 04 05:50:57.428723 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 529/1085] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 05:50:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 900 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 05:50:57.444009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7523a1cd-b669-4b13-b572-d56a8e2c6680 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Calling method '.version_select at 0x7f04865ad1f0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:57.523458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7523a1cd-b669-4b13-b572-d56a8e2c6680 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea" status: 200 len: 353 microversion: 2.1 time: 0.086114 Oct 04 05:50:57.524489 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 557/1086] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:57 2022] GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:57.631195 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:57.631816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:57.638964 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:57.639393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:57.639834 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:57.640527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:57.640979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:57.641409 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:57.775374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:57.783801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-442a83a4-8d29-4001-952c-ce98faece3dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.157583 Oct 04 05:50:57.784457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 530/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:57 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:50:58.538162 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cf8ea37e-b704-4c8b-ab68-aab0a5c290a1 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Calling method '.version_select at 0x7f048662e280>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:58.585534 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cf8ea37e-b704-4c8b-ab68-aab0a5c290a1 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea" status: 200 len: 354 microversion: 2.1 time: 0.051709 Oct 04 05:50:58.586100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 558/1088] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:58 2022] GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:58.598919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-04e238f1-62bc-4ba6-8301-16ec908fc5ff tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Calling method '.version_select at 0x7f04866a50d0>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:58.650129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-04e238f1-62bc-4ba6-8301-16ec908fc5ff tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea" status: 200 len: 354 microversion: 2.1 time: 0.054676 Oct 04 05:50:58.651198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 531/1089] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:58 2022] GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:50:58.664404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-30ad32a2-2fca-46fe-9211-eb7729269871 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Calling method '.version_select at 0x7f04865ec1f0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:58.809743 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:58.809743 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:50:58.814357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:58.814847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:58.815846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:58.816129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:50:58.816413 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:50:58.817073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:50:58.839697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-30ad32a2-2fca-46fe-9211-eb7729269871 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea" status: 202 len: 0 microversion: 2.1 time: 0.179112 Oct 04 05:50:58.840264 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 559/1090] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:50:58 2022] DELETE /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:50:58.849282 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d424ff6b-f74c-4117-a66c-fd65f7137ee2 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Calling method '.version_select at 0x7f0489e39af0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:50:58.968796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:50:58.977875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a2f38ac4-5761-41c0-a2e0-f95693c5ea26 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.174855 Oct 04 05:50:58.978804 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 532/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:58 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:50:59.077580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d424ff6b-f74c-4117-a66c-fd65f7137ee2 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea" status: 200 len: 353 microversion: 2.1 time: 0.231853 Oct 04 05:50:59.077580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 560/1092] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:50:58 2022] GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea => generated 353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:51:00.001842 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:00.002604 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:00.009705 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:00.012390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:00.012390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:00.012390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:00.012390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:00.012848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:00.016269 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:00.091762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b02cf164-4f43-4840-ad01-40c9dfa24ed3 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Calling method '.version_select at 0x7f04866da4c0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:00.120991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-b02cf164-4f43-4840-ad01-40c9dfa24ed3 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] HTTP exception thrown: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b02cf164-4f43-4840-ad01-40c9dfa24ed3 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Request method failure captured: Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea HTTP/1.1 Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8nAXjkw6-VIWFQ09jmJy-9gtsmpZBKA_bo0GMDaNskhoA-u-Fg0zxHay8ZxAoyBnHhgx_IJxy-pp-hDvmV7rHVWLuZNRrJUvg1x1wXAXmhy8J1ZQNcopgI0w-95CwCsTOWKjpnGKwfkGHMmgpr2zjhOBu9pel63iC7rSjrUCFLJGEA Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: a3a0e8fcefcf4cd5bdb012232d95f3ce Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesGetTestJSON-24226843 Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:51:00.123105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a3a0e8fcefcf4cd5bdb012232d95f3ce", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a3a0e8fcefcf4cd5bdb012232d95f3ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a3a0e8fcefcf4cd5bdb012232d95f3ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a3a0e8fcefcf4cd5bdb012232d95f3ce"}]}] Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesGetTestJSON-24226843 Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: a3a0e8fcefcf4cd5bdb012232d95f3ce Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesGetTestJSON-24226843 Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesGetTestJSON-24226843-project Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 724037b049ec4714a148fcd977463231 Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesGetTestJSON-24226843-project Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '855999b0-88af-4175-896b-97d30d0d17ea'} Oct 04 05:51:00.124644 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. (HTTP 404) (Request-ID: req-89cffff4-a6f8-4ee4-9db3-93f3c36a761c) Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:00.125543 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:51:00.126915 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 05:51:00.128137 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b02cf164-4f43-4840-ad01-40c9dfa24ed3 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] Returning 404 to user: Volume 855999b0-88af-4175-896b-97d30d0d17ea could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b02cf164-4f43-4840-ad01-40c9dfa24ed3 tempest-VolumesGetTestJSON-24226843 tempest-VolumesGetTestJSON-24226843-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea" status: 404 len: 109 microversion: 2.1 time: 0.037438 Oct 04 05:51:00.129387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 561/1093] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:51:00 2022] GET /compute/v2.1/os-volumes/855999b0-88af-4175-896b-97d30d0d17ea => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:51:00.161672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:00.169397 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cc46e86e-1eb5-48bf-a588-0bacdd067592 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.171489 Oct 04 05:51:00.170191 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 533/1094] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:50:59 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:01.199390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:01.200736 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-912fb562-d88e-4590-9e3a-a40ba1c13849 req-9b880a42-0c27-49ac-90be-ebc9d4930152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7", "name": "network-vif-plugged", "status": "completed", "tag": "f35de6bd-faf9-47cd-8910-fb186f4a737c"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:01.207423 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:01.214631 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:01.215120 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:01.215556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:01.220376 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:01.220842 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:01.221299 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:01.227574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-912fb562-d88e-4590-9e3a-a40ba1c13849 req-9b880a42-0c27-49ac-90be-ebc9d4930152 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:01.227574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-912fb562-d88e-4590-9e3a-a40ba1c13849 req-9b880a42-0c27-49ac-90be-ebc9d4930152 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:01.227574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-912fb562-d88e-4590-9e3a-a40ba1c13849 req-9b880a42-0c27-49ac-90be-ebc9d4930152 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:01.236430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-912fb562-d88e-4590-9e3a-a40ba1c13849 req-9b880a42-0c27-49ac-90be-ebc9d4930152 service nova] Creating event network-vif-plugged:f35de6bd-faf9-47cd-8910-fb186f4a737c for instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 on hv-cinder-84914 Oct 04 05:51:01.242063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-912fb562-d88e-4590-9e3a-a40ba1c13849 req-9b880a42-0c27-49ac-90be-ebc9d4930152 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054188 Oct 04 05:51:01.242685 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 562/1095] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:51:01.365720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:01.375555 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2077a579-90ce-480b-a2c9-e234eb865ff6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.182920 Oct 04 05:51:01.375769 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 534/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:01 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:02.401378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:02.402072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:02.412968 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:02.416976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:02.416976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:02.416976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:02.416976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:02.417946 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:02.830955 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ccc44270-3801-497a-b4bc-2652c93b235a tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Action: 'create', calling method: .version_select at 0x7f04866e5ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-486399517", "metadata": {"Type": "work"}}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ccc44270-3801-497a-b4bc-2652c93b235a tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Request method failure captured: Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 121 Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8nG9TwE7e2TeDTm5wqlk5IS7QV3ISiaK0wirIlwlOdvQPsHOIHPo3aOaATDuasl5tR-encRM6O2rPFz_yJXB94sqX71Mhx-8SHf2L9zRDIUQJ5s1sGoKW4I_cSQup6PsJf3xWTT1K5RsuG4KiVgWY5MTD2sIj-tpYBAqmtLeIUaivg Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:51:02.842221 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5195738e9a49da8a1dcd11426e2d4c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}] Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 4b01aa2e35204ae9a3e30d98abf870f3 Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-486399517", "metadata": {"Type": "work"}}} Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: Oct 04 05:51:02.846227 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-486399517', 'metadata': {'Type': 'work'}}}} Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise error Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:02.847436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 05:51:02.849803 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 05:51:02.851296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 05:51:02.851296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.851296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-ccc44270-3801-497a-b4bc-2652c93b235a tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:02.851296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-ccc44270-3801-497a-b4bc-2652c93b235a tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.224304 Oct 04 05:51:02.853038 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 535/1097] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 05:51:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:51:02.859160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:02.859994 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf5ae3b7-8e49-4a2e-a59f-111242669b91 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Action: 'create', calling method: .version_select at 0x7f04866a5dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1642232061", "metadata": {"Type": "work"}}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf5ae3b7-8e49-4a2e-a59f-111242669b91 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Request method failure captured: Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 120 Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8nG9TwE7e2TeDTm5wqlk5IS7QV3ISiaK0wirIlwlOdvQPsHOIHPo3aOaATDuasl5tR-encRM6O2rPFz_yJXB94sqX71Mhx-8SHf2L9zRDIUQJ5s1sGoKW4I_cSQup6PsJf3xWTT1K5RsuG4KiVgWY5MTD2sIj-tpYBAqmtLeIUaivg Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:51:02.865189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5195738e9a49da8a1dcd11426e2d4c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}] Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 4b01aa2e35204ae9a3e30d98abf870f3 Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1642232061", "metadata": {"Type": "work"}}} Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: Oct 04 05:51:02.866930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1642232061', 'metadata': {'Type': 'work'}}}} Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise error Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi '0' Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:02.868138 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 05:51:02.870398 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 05:51:02.872799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 05:51:02.872799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.872799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf5ae3b7-8e49-4a2e-a59f-111242669b91 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:02.872799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cf5ae3b7-8e49-4a2e-a59f-111242669b91 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012681 Oct 04 05:51:02.872799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 536/1098] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 05:51:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:51:02.877194 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9aa2ae1d-768d-4705-8c31-50462f4395bc tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1266 microversion: 2.1 time: 0.480104 Oct 04 05:51:02.878099 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 563/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:02 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1266 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:02.886447 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0e1bd425-7505-4522-a66a-7e16e85f75a3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Action: 'create', calling method: .version_select at 0x7f0486593940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539070539", "metadata": {"Type": "work"}}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0e1bd425-7505-4522-a66a-7e16e85f75a3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Request method failure captured: Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 118 Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8nG9TwE7e2TeDTm5wqlk5IS7QV3ISiaK0wirIlwlOdvQPsHOIHPo3aOaATDuasl5tR-encRM6O2rPFz_yJXB94sqX71Mhx-8SHf2L9zRDIUQJ5s1sGoKW4I_cSQup6PsJf3xWTT1K5RsuG4KiVgWY5MTD2sIj-tpYBAqmtLeIUaivg Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:51:02.895064 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5195738e9a49da8a1dcd11426e2d4c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}] Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 4b01aa2e35204ae9a3e30d98abf870f3 Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539070539", "metadata": {"Type": "work"}}} Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: Oct 04 05:51:02.897187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-539070539', 'metadata': {'Type': 'work'}}}} Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise error Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi '' Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:02.898259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 05:51:02.900073 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 05:51:02.902045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 05:51:02.902045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.902274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0e1bd425-7505-4522-a66a-7e16e85f75a3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:02.903363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0e1bd425-7505-4522-a66a-7e16e85f75a3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022162 Oct 04 05:51:02.904621 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 537/1100] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 4 05:51:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 05:51:02.915502 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-56e94fd5-251a-445c-bb7c-0f901aac74c3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Calling method '.version_select at 0x7f04865c3a60>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:02.951063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-56e94fd5-251a-445c-bb7c-0f901aac74c3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] HTTP exception thrown: Volume tempest-invalid-1801344343 could not be found. Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-56e94fd5-251a-445c-bb7c-0f901aac74c3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Request method failure captured: Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1801344343 HTTP/1.1 Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8nG9TwE7e2TeDTm5wqlk5IS7QV3ISiaK0wirIlwlOdvQPsHOIHPo3aOaATDuasl5tR-encRM6O2rPFz_yJXB94sqX71Mhx-8SHf2L9zRDIUQJ5s1sGoKW4I_cSQup6PsJf3xWTT1K5RsuG4KiVgWY5MTD2sIj-tpYBAqmtLeIUaivg Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:51:02.953191 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5195738e9a49da8a1dcd11426e2d4c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}] Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 4b01aa2e35204ae9a3e30d98abf870f3 Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Volume tempest-invalid-1801344343 could not be found. Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'tempest-invalid-1801344343'} Oct 04 05:51:02.954875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1801344343 could not be found. (HTTP 404) (Request-ID: req-2479c212-7570-45bb-b003-758ba09aa6a2) Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.955908 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 05:51:02.957347 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1801344343 could not be found. Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:51:02.959378 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1801344343 could not be found. Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1801344343 could not be found. Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-56e94fd5-251a-445c-bb7c-0f901aac74c3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Returning 404 to user: Volume tempest-invalid-1801344343 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-56e94fd5-251a-445c-bb7c-0f901aac74c3 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1801344343" status: 404 len: 99 microversion: 2.1 time: 0.043308 Oct 04 05:51:02.961022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 564/1101] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 4 05:51:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1801344343 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 05:51:02.965334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2b897f26-512d-4477-b264-2f6c484e0026 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003957 Oct 04 05:51:02.969749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 538/1102] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 4 05:51:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 05:51:02.977026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f8c02709-b227-4067-bc1c-fc31dcdb57d7 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003670 Oct 04 05:51:02.977506 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 565/1103] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 4 05:51:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 05:51:02.986690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9bf48c65-2386-4565-8750-1767a4c5f1df tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Calling method '.version_select at 0x7f0486718040>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:03.030630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-9bf48c65-2386-4565-8750-1767a4c5f1df tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] HTTP exception thrown: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9bf48c65-2386-4565-8750-1767a4c5f1df tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Request method failure captured: Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/os-volumes/4c32e00e-01c9-4cf8-b911-5fddd529d4dc HTTP/1.1 Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8nG9TwE7e2TeDTm5wqlk5IS7QV3ISiaK0wirIlwlOdvQPsHOIHPo3aOaATDuasl5tR-encRM6O2rPFz_yJXB94sqX71Mhx-8SHf2L9zRDIUQJ5s1sGoKW4I_cSQup6PsJf3xWTT1K5RsuG4KiVgWY5MTD2sIj-tpYBAqmtLeIUaivg Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:51:03.032761 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5195738e9a49da8a1dcd11426e2d4c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}] Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 4b01aa2e35204ae9a3e30d98abf870f3 Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '4c32e00e-01c9-4cf8-b911-5fddd529d4dc'} Oct 04 05:51:03.034425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. (HTTP 404) (Request-ID: req-d9336202-0cd3-41c1-957c-b85b6eef2db7) Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:03.035712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 05:51:03.037731 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 05:51:03.046696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9bf48c65-2386-4565-8750-1767a4c5f1df tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Returning 404 to user: Volume 4c32e00e-01c9-4cf8-b911-5fddd529d4dc could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9bf48c65-2386-4565-8750-1767a4c5f1df tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/4c32e00e-01c9-4cf8-b911-5fddd529d4dc" status: 404 len: 109 microversion: 2.1 time: 0.058667 Oct 04 05:51:03.048642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 539/1104] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 4 05:51:02 2022] DELETE /compute/v2.1/os-volumes/4c32e00e-01c9-4cf8-b911-5fddd529d4dc => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:51:03.055832 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9c9f1bb6-d288-4dab-b95a-9b1e363fb2e5 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Calling method '.version_select at 0x7f04865ec820>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:03.086757 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-9c9f1bb6-d288-4dab-b95a-9b1e363fb2e5 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] HTTP exception thrown: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9c9f1bb6-d288-4dab-b95a-9b1e363fb2e5 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Request method failure captured: Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/os-volumes/9d3e512e-69b5-4d48-b9e8-a7c484ef103f HTTP/1.1 Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8nG9TwE7e2TeDTm5wqlk5IS7QV3ISiaK0wirIlwlOdvQPsHOIHPo3aOaATDuasl5tR-encRM6O2rPFz_yJXB94sqX71Mhx-8SHf2L9zRDIUQJ5s1sGoKW4I_cSQup6PsJf3xWTT1K5RsuG4KiVgWY5MTD2sIj-tpYBAqmtLeIUaivg Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:51:03.088701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5195738e9a49da8a1dcd11426e2d4c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5195738e9a49da8a1dcd11426e2d4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5195738e9a49da8a1dcd11426e2d4c"}]}] Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: fb5195738e9a49da8a1dcd11426e2d4c Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesNegativeTest-1946733618 Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 4b01aa2e35204ae9a3e30d98abf870f3 Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesNegativeTest-1946733618-project Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '9d3e512e-69b5-4d48-b9e8-a7c484ef103f'} Oct 04 05:51:03.090404 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. (HTTP 404) (Request-ID: req-d5a6b54c-9a65-4953-a292-2ad8866176e7) Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:03.091236 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 05:51:03.093100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 05:51:03.096425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-9c9f1bb6-d288-4dab-b95a-9b1e363fb2e5 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] Returning 404 to user: Volume 9d3e512e-69b5-4d48-b9e8-a7c484ef103f could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-9c9f1bb6-d288-4dab-b95a-9b1e363fb2e5 tempest-VolumesNegativeTest-1946733618 tempest-VolumesNegativeTest-1946733618-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9d3e512e-69b5-4d48-b9e8-a7c484ef103f" status: 404 len: 109 microversion: 2.1 time: 0.039875 Oct 04 05:51:03.097646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 566/1105] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 4 05:51:03 2022] GET /compute/v2.1/os-volumes/9d3e512e-69b5-4d48-b9e8-a7c484ef103f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:51:03.907788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:03.909742 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:03.917513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:03.919452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:03.920363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:03.921050 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:03.922072 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:03.922798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:03.923527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:04.145619 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:04.153627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-18f726ce-9d30-4048-85d1-9dec1407f631 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1453 microversion: 2.1 time: 0.250631 Oct 04 05:51:04.154480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 540/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:03 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1453 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:04.181176 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:04.181889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:04.184069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:04.190990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:04.191479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:04.192166 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:04.192871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:04.193935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:04.194433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:04.370720 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:04.378679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1be8f9d3-e01e-4896-929d-4525a455c524 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1453 microversion: 2.1 time: 0.203037 Oct 04 05:51:04.379234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 567/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:04 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:06.642016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-4e48b5ef-eb4c-4190-b223-8ffcae5643d8 req-b1c9a517-ef1e-443f-86d6-3bac6c0290e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7", "tag": "f35de6bd-faf9-47cd-8910-fb186f4a737c"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:06.655939 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-4e48b5ef-eb4c-4190-b223-8ffcae5643d8 req-b1c9a517-ef1e-443f-86d6-3bac6c0290e7 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:06.656480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-4e48b5ef-eb4c-4190-b223-8ffcae5643d8 req-b1c9a517-ef1e-443f-86d6-3bac6c0290e7 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:06.657118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-4e48b5ef-eb4c-4190-b223-8ffcae5643d8 req-b1c9a517-ef1e-443f-86d6-3bac6c0290e7 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:06.670187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-4e48b5ef-eb4c-4190-b223-8ffcae5643d8 req-b1c9a517-ef1e-443f-86d6-3bac6c0290e7 service nova] Creating event network-changed:f35de6bd-faf9-47cd-8910-fb186f4a737c for instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 on hv-cinder-84914 Oct 04 05:51:06.679570 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-4e48b5ef-eb4c-4190-b223-8ffcae5643d8 req-b1c9a517-ef1e-443f-86d6-3bac6c0290e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049390 Oct 04 05:51:06.679820 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 541/1108] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:51:10.540391 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1127108925", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "networks": [{"uuid": "054e38c8-2aec-43e2-bf59-58fc8df75793"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:10.595130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] validate_networks() for [('054e38c8-2aec-43e2-bf59-58fc8df75793', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:51:10.976907 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:51:10.977327 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:51:10.977834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:51:10.978273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:51:10.978712 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:51:10.987618 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:10.988101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:10.988531 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:10.989344 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:10.992471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:10.992471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:11.008713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Getting quotas for project a1efce1ebdf1425396c2babae74fe6ce. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:51:11.012834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Getting quotas for user e04f49a794c5487ba372cf1baaf67402 and project a1efce1ebdf1425396c2babae74fe6ce. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:51:11.025791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:51:11.028147 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:51:11.171202 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e82b0d5e-237a-4aa6-afda-ac4b1e504f26 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634905 Oct 04 05:51:11.172082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 568/1109] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:51:11.185274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-be083fdd-9935-43b2-8699-7faab177dc92 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:11.186098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-be083fdd-9935-43b2-8699-7faab177dc92 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:11.251563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-be083fdd-9935-43b2-8699-7faab177dc92 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:11.261623 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-be083fdd-9935-43b2-8699-7faab177dc92 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1214 microversion: 2.1 time: 0.081211 Oct 04 05:51:11.262597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 542/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:11 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:12.285846 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-915e1923-56ed-469a-a620-f73aa49d779a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:12.286513 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-915e1923-56ed-469a-a620-f73aa49d779a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:12.341891 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-915e1923-56ed-469a-a620-f73aa49d779a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:12.349145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-915e1923-56ed-469a-a620-f73aa49d779a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1214 microversion: 2.1 time: 0.067857 Oct 04 05:51:12.350257 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 569/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:12 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:13.372848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:13.373495 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:13.381198 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:13.381675 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:13.382102 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:13.382815 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:13.383259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:13.383675 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:13.444112 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:13.451899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-94dcad06-f235-449d-9e7d-54e60992ea90 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1210 microversion: 2.1 time: 0.083058 Oct 04 05:51:13.452754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 543/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:13 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:14.475019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:14.475631 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:14.482118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:14.482622 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:14.483058 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:14.483738 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:14.484196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:14.484620 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:14.547801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:14.555897 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b864da41-5f02-446b-9efc-ad8477ce95f6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1210 microversion: 2.1 time: 0.084791 Oct 04 05:51:14.556484 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 570/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:14 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:15.579885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:15.580491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:15.587424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:15.587908 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:15.588343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:15.589027 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:15.589476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:15.589915 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:15.653153 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:15.661690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-6d317344-ed65-4ddf-a61f-acac8e2cd416 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1210 microversion: 2.1 time: 0.085604 Oct 04 05:51:15.662482 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 544/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:15 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:16.684813 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:16.685513 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:16.691910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:16.693188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:16.693790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:16.694912 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:16.695366 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:16.695966 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:16.777642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:16.789776 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0a8f786b-ec32-47ac-b36f-fda9e75e7a41 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1274 microversion: 2.1 time: 0.108682 Oct 04 05:51:16.790702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 571/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:16 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:17.813218 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:17.816461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:17.821620 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:17.822099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:17.822553 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:17.823622 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:17.824276 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:17.824912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:17.998313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:18.006749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-44de8478-d26c-45d2-b822-a037c60b7be6 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.197607 Oct 04 05:51:18.007647 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 545/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:17 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:18.489831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-7e97cb46-5733-49bb-a6e4-673c6670577f req-f7962e15-185d-4a27-8c75-15efd20542a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766306cb-5443-4875-88a1-7e7a0725323e", "tag": "59ec5150-bdfa-4c69-a085-fd6cd7f9abec"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:18.509442 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-7e97cb46-5733-49bb-a6e4-673c6670577f req-f7962e15-185d-4a27-8c75-15efd20542a9 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:18.510232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-7e97cb46-5733-49bb-a6e4-673c6670577f req-f7962e15-185d-4a27-8c75-15efd20542a9 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:18.510843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-7e97cb46-5733-49bb-a6e4-673c6670577f req-f7962e15-185d-4a27-8c75-15efd20542a9 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:18.532612 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-7e97cb46-5733-49bb-a6e4-673c6670577f req-f7962e15-185d-4a27-8c75-15efd20542a9 service nova] Creating event network-changed:59ec5150-bdfa-4c69-a085-fd6cd7f9abec for instance 766306cb-5443-4875-88a1-7e7a0725323e on hv-cinder-84914 Oct 04 05:51:18.532612 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-7e97cb46-5733-49bb-a6e4-673c6670577f req-f7962e15-185d-4a27-8c75-15efd20542a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044827 Oct 04 05:51:18.532612 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 572/1117] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:51:19.030833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:19.031452 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:19.038606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:19.039118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:19.039557 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:19.040259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:19.040718 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:19.041150 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:19.261561 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:19.270648 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5f30c5c9-c15d-4b53-992c-5da0799de178 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.243490 Oct 04 05:51:19.287575 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 546/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:19 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:20.296258 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:20.301641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:20.304588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:20.305248 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:20.305812 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:20.306529 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:20.307007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:20.307408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:20.436044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:20.444063 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7cb6fced-b996-4f67-9606-b57b5707c0e0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.152023 Oct 04 05:51:20.444630 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 573/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:20 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:21.467833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:21.468385 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:21.470792 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:21.475568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:21.476045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:21.476478 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:21.477165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:21.477612 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:21.478035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:21.613453 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:21.622116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f43caca1-d590-464a-ae73-04a9f5b54a21 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.158203 Oct 04 05:51:21.636833 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 547/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:21 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:22.647338 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:22.647940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:22.655115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:22.657234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=8 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:22.658933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:22.668314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:22.668314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:22.668314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:22.668314 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:22.668791 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:23.028509 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:23.038626 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b10fcfb6-fdb5-45c2-8260-4775be0d6a05 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.395475 Oct 04 05:51:23.050734 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 574/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:22 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:23.306882 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-6d2b27a6-51a3-4eff-841c-64e3ced2960b req-b566665d-3dc2-436e-a360-1809cea78e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766306cb-5443-4875-88a1-7e7a0725323e", "name": "network-vif-plugged", "status": "completed", "tag": "59ec5150-bdfa-4c69-a085-fd6cd7f9abec"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:23.320407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6d2b27a6-51a3-4eff-841c-64e3ced2960b req-b566665d-3dc2-436e-a360-1809cea78e65 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:23.320917 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6d2b27a6-51a3-4eff-841c-64e3ced2960b req-b566665d-3dc2-436e-a360-1809cea78e65 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:23.321350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6d2b27a6-51a3-4eff-841c-64e3ced2960b req-b566665d-3dc2-436e-a360-1809cea78e65 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:23.337298 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-6d2b27a6-51a3-4eff-841c-64e3ced2960b req-b566665d-3dc2-436e-a360-1809cea78e65 service nova] Creating event network-vif-plugged:59ec5150-bdfa-4c69-a085-fd6cd7f9abec for instance 766306cb-5443-4875-88a1-7e7a0725323e on hv-cinder-84914 Oct 04 05:51:23.343098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-6d2b27a6-51a3-4eff-841c-64e3ced2960b req-b566665d-3dc2-436e-a360-1809cea78e65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039746 Oct 04 05:51:23.343997 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 548/1122] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:51:24.062975 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:24.063589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:24.071871 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:24.072433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:24.072873 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:24.073648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:24.074156 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:24.074607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:24.212976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:24.220651 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8791321a-60d8-44d0-9f8c-047c8adfa190 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.161930 Oct 04 05:51:24.221214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 575/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:24 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:25.246115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:25.247469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:25.259233 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:25.259715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:25.260332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:25.261035 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:25.261480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:25.261903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:25.401659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:25.409899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a33efcb5-1053-4626-b0d3-9d941a1e153c tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1314 microversion: 2.1 time: 0.169376 Oct 04 05:51:25.410512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 549/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:25 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:26.433351 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:26.433977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:26.441408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:26.441896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:26.442671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:26.443364 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:26.447573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:26.447573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:26.463025 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=63 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:26.580215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:26.592532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d617cdde-ff16-4f5c-b1aa-d2c806bc7971 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1497 microversion: 2.1 time: 0.158963 Oct 04 05:51:26.592532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 576/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:26 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:27.964994 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:27.965568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:27.972034 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:27.972595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:27.973095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:27.974578 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:27.975093 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:27.975646 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:28.001598 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Going to try to terminate instance {{(pid=127393) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:51:28.203047 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b0ec2d12-2557-4357-aba9-6bb297e4e952 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "DELETE /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 204 len: 0 microversion: 2.1 time: 0.242301 Oct 04 05:51:28.203653 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 550/1126] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:51:27 2022] DELETE /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:51:28.212721 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:28.213465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:28.220545 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:28.221190 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:28.227342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:28.227342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:28.227342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:28.227342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:28.357777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:28.365770 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1c13f4e8-cf1c-4166-963a-2745662b2376 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1503 microversion: 2.1 time: 0.157668 Oct 04 05:51:28.366373 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 577/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:28 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:29.391238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:29.391934 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:29.398432 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:29.399053 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:29.399488 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:29.400173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:29.400692 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:29.401124 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:29.542305 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:29.550508 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-44f43b26-6774-41f6-960d-7b6feaf3c8cc tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1503 microversion: 2.1 time: 0.163487 Oct 04 05:51:29.551079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 551/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:29 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:30.574777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:30.575384 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:30.581953 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:30.582464 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:30.582905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:30.583605 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:30.584197 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:30.584469 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:30.725610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:30.735341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e3868fb9-d4af-4768-b102-85372460ded0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1503 microversion: 2.1 time: 0.164383 Oct 04 05:51:30.735910 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 578/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:30 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:31.758917 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:31.759522 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:31.766251 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:31.766713 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:31.767233 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:31.767921 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:31.768408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:31.768832 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:31.773593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:31.904024 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:31.912582 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-053b4419-4d73-40b7-ae20-3e86f9f721d3 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1503 microversion: 2.1 time: 0.157416 Oct 04 05:51:31.913011 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 552/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:31 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:32.935679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:32.936215 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:32.943297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:32.943777 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:32.944205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:32.944890 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:32.945341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:32.945760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:33.082943 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:33.091123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8299ded8-72e6-4656-b262-ab78a3368141 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1503 microversion: 2.1 time: 0.159073 Oct 04 05:51:33.091345 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 579/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:32 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:34.113747 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:34.114905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:34.121663 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:34.122165 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:34.122597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:34.123264 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:34.123709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:34.124127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:34.249567 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:34.257889 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e00f9760-a218-44f0-87bd-bb1f7a5e7f78 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1503 microversion: 2.1 time: 0.148301 Oct 04 05:51:34.258498 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 553/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:34 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:35.282768 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:35.283865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:35.291408 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:35.292278 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:35.292709 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:35.293413 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:35.293867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:35.294460 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:35.353005 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-6d7805bf-756b-40ae-9fb6-328e8bb54e84 req-2e00f9c9-a18f-4951-b8e9-c573239ba6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766306cb-5443-4875-88a1-7e7a0725323e", "name": "network-vif-deleted", "tag": "59ec5150-bdfa-4c69-a085-fd6cd7f9abec"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:35.361746 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:35.363454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6d7805bf-756b-40ae-9fb6-328e8bb54e84 req-2e00f9c9-a18f-4951-b8e9-c573239ba6c8 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:35.363928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6d7805bf-756b-40ae-9fb6-328e8bb54e84 req-2e00f9c9-a18f-4951-b8e9-c573239ba6c8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:35.364348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-6d7805bf-756b-40ae-9fb6-328e8bb54e84 req-2e00f9c9-a18f-4951-b8e9-c573239ba6c8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:35.369542 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-526a8a2e-c5d2-4a8b-9345-ed9a884d654f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1461 microversion: 2.1 time: 0.092913 Oct 04 05:51:35.370103 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 580/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:35 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:35.377882 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-6d7805bf-756b-40ae-9fb6-328e8bb54e84 req-2e00f9c9-a18f-4951-b8e9-c573239ba6c8 service nova] Creating event network-vif-deleted:59ec5150-bdfa-4c69-a085-fd6cd7f9abec for instance 766306cb-5443-4875-88a1-7e7a0725323e on hv-cinder-84914 Oct 04 05:51:35.383370 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-6d7805bf-756b-40ae-9fb6-328e8bb54e84 req-2e00f9c9-a18f-4951-b8e9-c573239ba6c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Oct 04 05:51:35.384039 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 554/1134] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:51:36.392595 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:36.393228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:36.399648 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:36.400124 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:36.400596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:36.401275 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:36.401719 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:36.402150 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:36.435380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:36.435865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:36.436434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:36.436885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lazy-loading 'fault' on Instance uuid 766306cb-5443-4875-88a1-7e7a0725323e {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:51:36.492567 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:36.500334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-98900e18-1686-410a-bef0-222d57b2ad85 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 200 len: 1304 microversion: 2.1 time: 0.111691 Oct 04 05:51:36.500926 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 581/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:36 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:37.524935 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:37.526332 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: 766306cb-5443-4875-88a1-7e7a0725323e] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:37.533384 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:37.533863 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:37.534333 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:37.535030 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:37.535476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:37.535898 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:37.549374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] HTTP exception thrown: Instance 766306cb-5443-4875-88a1-7e7a0725323e could not be found. Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Request method failure captured: Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e HTTP/1.1 Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8nMEIdm3cvgisne7yhuMUgJ2oIZkfp7nblFn-UhYOB08DmG3dS_NF9I2ZbyeuPykAf96YZ-ZS3VA6UKdZw1p6Agp1160nU70iW8URyFlF3lA-sHP_b1dFtFlFEIncDFqg-iwMjNxIKENDaSLbQwh8HaJ6GVmhritxXByQMJOJhF07c Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: a1efce1ebdf1425396c2babae74fe6ce Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-VolumesActionsTest-1599749294 Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:51:37.551016 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a1efce1ebdf1425396c2babae74fe6ce", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1efce1ebdf1425396c2babae74fe6ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a1efce1ebdf1425396c2babae74fe6ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1efce1ebdf1425396c2babae74fe6ce"}]}] Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-VolumesActionsTest-1599749294 Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: a1efce1ebdf1425396c2babae74fe6ce Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-VolumesActionsTest-1599749294 Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-VolumesActionsTest-1599749294-project Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: e04f49a794c5487ba372cf1baaf67402 Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-VolumesActionsTest-1599749294-project Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 766306cb-5443-4875-88a1-7e7a0725323e could not be found. Oct 04 05:51:37.552696 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '766306cb-5443-4875-88a1-7e7a0725323e'} Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766306cb-5443-4875-88a1-7e7a0725323e could not be found. Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:37.553785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766306cb-5443-4875-88a1-7e7a0725323e could not be found. Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766306cb-5443-4875-88a1-7e7a0725323e could not be found. Oct 04 05:51:37.555171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:51:37.556367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Returning 404 to user: Instance 766306cb-5443-4875-88a1-7e7a0725323e could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:37.556367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-df553153-4398-44f8-9999-cea453972a00 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e" status: 404 len: 111 microversion: 2.1 time: 0.032834 Oct 04 05:51:37.556367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 555/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:37 2022] GET /compute/v2.1/servers/766306cb-5443-4875-88a1-7e7a0725323e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:51:37.659498 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-622617216", "imageRef": "f9837933-ac62-4093-b0ea-5e055f002949", "flavorRef": "452", "networks": [{"uuid": "054e38c8-2aec-43e2-bf59-58fc8df75793"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:37.715132 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] validate_networks() for [('054e38c8-2aec-43e2-bf59-58fc8df75793', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:51:38.087213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:51:38.087668 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:51:38.088143 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:51:38.092806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:51:38.092806 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:51:38.097997 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:38.098505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:38.098942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:38.100171 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:38.100624 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:38.101175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:38.118277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Getting quotas for project a1efce1ebdf1425396c2babae74fe6ce. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:51:38.122518 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Getting quotas for user e04f49a794c5487ba372cf1baaf67402 and project a1efce1ebdf1425396c2babae74fe6ce. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:51:38.135773 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:51:38.138169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9837933-ac62-4093-b0ea-5e055f002949',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:51:38.320522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-f6ff7ad2-2dc4-4cb4-92c2-db031165d69b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664727 Oct 04 05:51:38.321188 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 582/1137] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:51:38.332851 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b376c3d6-9772-4c55-a7f6-5f8d4ce64baf tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:38.333548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b376c3d6-9772-4c55-a7f6-5f8d4ce64baf tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:38.388957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b376c3d6-9772-4c55-a7f6-5f8d4ce64baf tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:38.396448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b376c3d6-9772-4c55-a7f6-5f8d4ce64baf tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1213 microversion: 2.1 time: 0.067589 Oct 04 05:51:38.397525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 556/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:38 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:39.419268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:39.420742 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:39.426921 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:39.427399 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:39.428447 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:39.429243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:39.429877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:39.430329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:39.495055 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:39.502787 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-bf567bc2-ff68-4bd3-8cd0-f50d15df92a0 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1217 microversion: 2.1 time: 0.087486 Oct 04 05:51:39.503357 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 583/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:39 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:40.527448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:40.528637 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:40.537346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:40.538187 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:40.538657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:40.539471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:40.539931 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:40.540343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:40.676178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:40.691135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b887b51a-e98a-40f9-9ef8-30caa0e108de tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1273 microversion: 2.1 time: 0.168183 Oct 04 05:51:40.694927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 557/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:40 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:41.718407 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:41.719797 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:41.725461 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:41.729870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:41.730424 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:41.730870 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:41.731593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:41.732483 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:41.733161 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:41.889028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:41.902342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-17eb2a5a-9e93-40d7-a609-d0ce4f79f4ce tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.190979 Oct 04 05:51:41.903865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 584/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:41 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:42.540816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-30cb14dc-e4fb-4533-8f3c-173a7816fc2e req-c549db7e-5fa7-4731-903e-715e60c76b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2de7bb8-2f42-4246-9e23-70c110c79799", "tag": "6b57ccbb-82de-454e-92b9-668493f61225"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:42.547139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:42.552899 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-30cb14dc-e4fb-4533-8f3c-173a7816fc2e req-c549db7e-5fa7-4731-903e-715e60c76b3f service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:42.553867 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-30cb14dc-e4fb-4533-8f3c-173a7816fc2e req-c549db7e-5fa7-4731-903e-715e60c76b3f service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:42.554340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-30cb14dc-e4fb-4533-8f3c-173a7816fc2e req-c549db7e-5fa7-4731-903e-715e60c76b3f service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:42.567129 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-30cb14dc-e4fb-4533-8f3c-173a7816fc2e req-c549db7e-5fa7-4731-903e-715e60c76b3f service nova] Creating event network-changed:6b57ccbb-82de-454e-92b9-668493f61225 for instance f2de7bb8-2f42-4246-9e23-70c110c79799 on hv-cinder-84914 Oct 04 05:51:42.572727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-30cb14dc-e4fb-4533-8f3c-173a7816fc2e req-c549db7e-5fa7-4731-903e-715e60c76b3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039017 Oct 04 05:51:42.573500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 558/1142] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:51:42.927312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:42.927881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:42.935996 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:42.936486 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:42.936914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:42.938087 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:42.938574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:42.939033 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:43.080167 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:43.088994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d3ab92f5-e8f9-4dd8-8974-3419017d5c8f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.166149 Oct 04 05:51:43.089576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 585/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:42 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:44.113323 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:44.114026 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:44.122023 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:44.122536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:44.122976 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:44.123679 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:44.124135 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:44.124569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:44.254734 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:44.262453 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2cbb8ff7-d496-4760-97e4-c6cbfb655eab tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.153789 Oct 04 05:51:44.263011 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 559/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:44 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:45.284889 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:45.285437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:45.292528 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:45.293000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:45.293433 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:45.294115 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:45.294586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:45.295038 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:45.433003 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:45.440770 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-10cdcfdb-2695-43e0-8a7e-6c9557b081e5 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.159823 Oct 04 05:51:45.441342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 586/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:45 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:46.465295 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:46.465893 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:46.473668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:46.473668 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:46.473924 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:46.474695 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:46.475167 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:46.475726 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:46.624313 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:46.639322 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8323797c-5389-4a81-a5d7-d7627aa8227e tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.177784 Oct 04 05:51:46.640309 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 560/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:46 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:47.667709 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:47.668411 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:47.676105 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:47.676597 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:47.677039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:47.677880 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:47.678241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:47.678669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:47.815205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:47.823797 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7616df90-cb00-4b40-a47b-b40f2fa641e9 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.163783 Oct 04 05:51:47.824375 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 587/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:47 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:48.070612 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-1a6a67f4-998e-4c5d-a01f-9d5b8b4c5c73 req-8bcd27d1-a0aa-4f6e-b867-4d19e4c29a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2de7bb8-2f42-4246-9e23-70c110c79799", "name": "network-vif-plugged", "status": "completed", "tag": "6b57ccbb-82de-454e-92b9-668493f61225"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:48.080295 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-1a6a67f4-998e-4c5d-a01f-9d5b8b4c5c73 req-8bcd27d1-a0aa-4f6e-b867-4d19e4c29a32 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:48.080788 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-1a6a67f4-998e-4c5d-a01f-9d5b8b4c5c73 req-8bcd27d1-a0aa-4f6e-b867-4d19e4c29a32 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:48.081210 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-1a6a67f4-998e-4c5d-a01f-9d5b8b4c5c73 req-8bcd27d1-a0aa-4f6e-b867-4d19e4c29a32 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:48.092932 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-1a6a67f4-998e-4c5d-a01f-9d5b8b4c5c73 req-8bcd27d1-a0aa-4f6e-b867-4d19e4c29a32 service nova] Creating event network-vif-plugged:6b57ccbb-82de-454e-92b9-668493f61225 for instance f2de7bb8-2f42-4246-9e23-70c110c79799 on hv-cinder-84914 Oct 04 05:51:48.098054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-1a6a67f4-998e-4c5d-a01f-9d5b8b4c5c73 req-8bcd27d1-a0aa-4f6e-b867-4d19e4c29a32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Oct 04 05:51:48.098701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 561/1148] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:51:48.847883 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:48.848497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:48.850359 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:48.851027 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:48.856896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:48.857380 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:48.857819 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:48.858640 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:48.859179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:48.859604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:48.993919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:49.001631 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-3f268954-d0d4-40dc-8df1-5d48e4041f1f tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1313 microversion: 2.1 time: 0.157808 Oct 04 05:51:49.002213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 588/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:48 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:51:50.021506 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:50.026769 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:50.027481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:50.033516 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:50.033944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:50.034444 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:50.038043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:50.038043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:50.038043 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:50.163018 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:50.170854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-fda4cba7-7966-4fab-9a97-b0a439f7977b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1496 microversion: 2.1 time: 0.150372 Oct 04 05:51:50.173338 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 562/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:50 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:51.094155 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:51.094679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:51.101028 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:51.101998 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:51.102458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:51.103147 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:51.103598 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:51.104024 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:51.128828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:51:51.477715 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b0c27253-a42a-4817-9321-f41565b9f32b tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 204 len: 0 microversion: 2.1 time: 0.387176 Oct 04 05:51:51.478334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 589/1151] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:51:51 2022] DELETE /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:51:51.494635 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:51.495267 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:51.501870 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:51.502390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:51.502853 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:51.503563 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:51.504031 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:51.504449 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:51.641306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:51.650494 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d2c6edda-4f5e-4e51-a027-ad8db5fa88be tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1502 microversion: 2.1 time: 0.159668 Oct 04 05:51:51.651079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 563/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:51 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:52.673454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:52.674167 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:52.680602 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:52.681082 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:52.681516 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:52.682232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:52.682689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:52.683109 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:52.816196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:52.825312 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4709745c-86ce-4a01-803b-f876d7e94b74 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1502 microversion: 2.1 time: 0.156052 Oct 04 05:51:52.825894 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 590/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:52 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:53.794674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-04ad5bc6-be4f-4b95-b721-b4b259bc54e4 req-020d2776-796f-4557-8049-738f884e28b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2de7bb8-2f42-4246-9e23-70c110c79799", "name": "network-vif-deleted", "tag": "6b57ccbb-82de-454e-92b9-668493f61225"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:51:53.804973 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-04ad5bc6-be4f-4b95-b721-b4b259bc54e4 req-020d2776-796f-4557-8049-738f884e28b4 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:53.805442 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-04ad5bc6-be4f-4b95-b721-b4b259bc54e4 req-020d2776-796f-4557-8049-738f884e28b4 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:53.805875 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-04ad5bc6-be4f-4b95-b721-b4b259bc54e4 req-020d2776-796f-4557-8049-738f884e28b4 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:53.816491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-04ad5bc6-be4f-4b95-b721-b4b259bc54e4 req-020d2776-796f-4557-8049-738f884e28b4 service nova] Creating event network-vif-deleted:6b57ccbb-82de-454e-92b9-668493f61225 for instance f2de7bb8-2f42-4246-9e23-70c110c79799 on hv-cinder-84914 Oct 04 05:51:53.821606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-04ad5bc6-be4f-4b95-b721-b4b259bc54e4 req-020d2776-796f-4557-8049-738f884e28b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Oct 04 05:51:53.822127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 564/1154] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:51:53.849036 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:53.849641 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:53.856789 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:53.857267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:53.857740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:53.858463 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:53.858907 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:53.859328 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:53.928959 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:53.931283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:51:53.937775 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ed0a104e-144a-4c76-8590-70eaf6c80430 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1460 microversion: 2.1 time: 0.092750 Oct 04 05:51:53.941875 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 591/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:53 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1460 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:51:54.963155 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:54.963854 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:54.970357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:54.970843 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:54.971280 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:54.972060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:54.972519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:54.972947 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:55.004300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:55.004764 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:55.005192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:55.005630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.objects.instance [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lazy-loading 'fault' on Instance uuid f2de7bb8-2f42-4246-9e23-70c110c79799 {{(pid=127393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:51:55.057466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04f49a794c5487ba372cf1baaf67402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1efce1ebdf1425396c2babae74fe6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:51:55.057466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0a6d8a5b-6dc0-4eb5-a2fd-85276ea18aa1 tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 200 len: 1303 microversion: 2.1 time: 0.097088 Oct 04 05:51:55.057466 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 565/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:54 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:51:56.081009 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:51:56.081610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] [instance: f2de7bb8-2f42-4246-9e23-70c110c79799] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:51:56.088363 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:56.088834 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:56.089262 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:56.089940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:51:56.090415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:51:56.090848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:51:56.104857 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] HTTP exception thrown: Instance f2de7bb8-2f42-4246-9e23-70c110c79799 could not be found. Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Request method failure captured: Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 HTTP/1.1 Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8nMEIdm3cvgisne7yhuMUgJ2oIZkfp7nblFn-UhYOB08DmG3dS_NF9I2ZbyeuPykAf96YZ-ZS3VA6UKdZw1p6Agp1160nU70iW8URyFlF3lA-sHP_b1dFtFlFEIncDFqg-iwMjNxIKENDaSLbQwh8HaJ6GVmhritxXByQMJOJhF07c Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: a1efce1ebdf1425396c2babae74fe6ce Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-VolumesActionsTest-1599749294 Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:51:56.106488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a1efce1ebdf1425396c2babae74fe6ce", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1efce1ebdf1425396c2babae74fe6ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a1efce1ebdf1425396c2babae74fe6ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1efce1ebdf1425396c2babae74fe6ce"}]}] Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-VolumesActionsTest-1599749294 Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: a1efce1ebdf1425396c2babae74fe6ce Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-VolumesActionsTest-1599749294 Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-VolumesActionsTest-1599749294-project Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: e04f49a794c5487ba372cf1baaf67402 Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-VolumesActionsTest-1599749294-project Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance f2de7bb8-2f42-4246-9e23-70c110c79799 could not be found. Oct 04 05:51:56.108186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': 'f2de7bb8-2f42-4246-9e23-70c110c79799'} Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2de7bb8-2f42-4246-9e23-70c110c79799 could not be found. Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:51:56.109198 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2de7bb8-2f42-4246-9e23-70c110c79799 could not be found. Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2de7bb8-2f42-4246-9e23-70c110c79799 could not be found. Oct 04 05:51:56.110568 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:51:56.111805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] Returning 404 to user: Instance f2de7bb8-2f42-4246-9e23-70c110c79799 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:51:56.111805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-10c97d00-a49b-40a2-a3ec-64d8b802934a tempest-VolumesActionsTest-1599749294 tempest-VolumesActionsTest-1599749294-project] 10.222.0.26 "GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799" status: 404 len: 111 microversion: 2.1 time: 0.031125 Oct 04 05:51:56.111805 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 592/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:51:56 2022] GET /compute/v2.1/servers/f2de7bb8-2f42-4246-9e23-70c110c79799 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:52:27.953901 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=17 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:52:27.958546 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=59 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:52:28.178430 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-010f6725-e7ad-4f9d-8ccf-455d44d3c56f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Action: 'create', calling method: .version_select at 0x7f048663d8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-518484721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJH+ZEiSb1nTD6hTl6wlVw6YrFlLLshFLWO+L8ExfTPcz1hf0o+yHhLAaA5GQsqRWk1ZO26wj4+WClNRqHjVGK6P99nVAQqcMSuTfeodI+sw0bBEClSfYwwZLfVnSj6YQ=="}} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:52:28.203666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-010f6725-e7ad-4f9d-8ccf-455d44d3c56f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Getting quotas for project c225dfb273d64b3e94f7dae792e4cd9d. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:52:28.210354 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.quota [None req-010f6725-e7ad-4f9d-8ccf-455d44d3c56f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Getting quotas for user 92f4eb565bdf49f197d6b2b4a3f17cc8 and project c225dfb273d64b3e94f7dae792e4cd9d. Resources: {'key_pairs'} {{(pid=127393) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:52:28.301083 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-010f6725-e7ad-4f9d-8ccf-455d44d3c56f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.353427 Oct 04 05:52:28.301698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 566/1158] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 4 05:52:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:52:48.476867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-700332179", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-518484721", "security_groups": [{"name": "tempest-secgroup-smoke-631589809"}], "networks": [{"uuid": "5e2d455b-6614-4c16-abd0-19c66ac5ba21"}], "block_device_mapping_v2": [{"uuid": "74ccfada-5d42-4edd-92f2-44725d8d3485", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:52:48.490098 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:52:48.796532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] validate_networks() for [('5e2d455b-6614-4c16-abd0-19c66ac5ba21', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:52:49.157120 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:52:49.157544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:52:49.158015 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:52:49.158465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:52:49.158877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:52:49.167963 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:49.168434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:49.168865 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:49.169580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:49.170022 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:49.170465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:49.186687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Getting quotas for project c225dfb273d64b3e94f7dae792e4cd9d. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:52:49.190548 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Getting quotas for user 92f4eb565bdf49f197d6b2b4a3f17cc8 and project c225dfb273d64b3e94f7dae792e4cd9d. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:52:49.246747 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:52:49.248888 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74ccfada-5d42-4edd-92f2-44725d8d3485',volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:52:49.603425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-42eac83b-53f7-4359-b9ee-01423ba255c9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.130338 Oct 04 05:52:49.604069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 593/1159] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:52:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:52:49.612721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=4 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:52:49.613457 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:52:49.617273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-29d3158b-9dda-430e-9098-aae9a99feaa3 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:49.617878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-29d3158b-9dda-430e-9098-aae9a99feaa3 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:49.772944 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-29d3158b-9dda-430e-9098-aae9a99feaa3 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:49.780874 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-29d3158b-9dda-430e-9098-aae9a99feaa3 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1087 microversion: 2.1 time: 0.169611 Oct 04 05:52:49.781436 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 567/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:49 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1087 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:50.800311 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 05:52:50.800807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Tue Oct 4 05:52:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f (ip 10.222.0.26) !!! Oct 04 05:52:50.804503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:50.805684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:50.812703 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:50.813175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:50.813627 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:50.814323 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:50.814767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:50.815187 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:50.875504 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:50.883336 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6ca8b6ce-84e1-4661-b447-172d96a2be13 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1129 microversion: 2.1 time: 0.084631 Oct 04 05:52:50.883886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 594/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:50 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1129 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:51.906420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:51.907023 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:51.913455 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:51.913970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:51.914529 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:51.915213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:51.915658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:51.916082 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:51.978517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:51.987786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-388ac875-8aa6-449b-8cdb-1fb12dca7575 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1193 microversion: 2.1 time: 0.085533 Oct 04 05:52:51.988378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 568/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:51 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:53.012054 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:53.012844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:53.019493 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:53.019977 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:53.020415 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:53.021110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:53.021566 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:53.021997 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:53.157885 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:53.165956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8f633b90-5547-4ae3-b221-1c09bcbc56e6 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1270 microversion: 2.1 time: 0.158271 Oct 04 05:52:53.166608 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 595/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:53 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:53.385676 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-9d140b46-f2ee-4187-9ae6-d46639f6d2e4 req-08a380bd-11e1-4826-8065-6b668062b303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:52:53.398579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-9d140b46-f2ee-4187-9ae6-d46639f6d2e4 req-08a380bd-11e1-4826-8065-6b668062b303 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:53.398579 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-9d140b46-f2ee-4187-9ae6-d46639f6d2e4 req-08a380bd-11e1-4826-8065-6b668062b303 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:53.398894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-9d140b46-f2ee-4187-9ae6-d46639f6d2e4 req-08a380bd-11e1-4826-8065-6b668062b303 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:53.411516 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-9d140b46-f2ee-4187-9ae6-d46639f6d2e4 req-08a380bd-11e1-4826-8065-6b668062b303 service nova] Creating event network-changed:7f6ca5a0-87bf-4f8b-b03d-724faba0c205 for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f on hv-cinder-84914 Oct 04 05:52:53.416912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-9d140b46-f2ee-4187-9ae6-d46639f6d2e4 req-08a380bd-11e1-4826-8065-6b668062b303 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034577 Oct 04 05:52:53.417380 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 569/1164] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 05:52:54.189079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:54.189692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:54.196205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:54.196689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:54.197131 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:54.197831 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:54.198319 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:54.198751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:54.330064 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:54.338130 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-6b4d032a-4d7c-49cb-8029-4deed6ce5a05 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.152874 Oct 04 05:52:54.338727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 596/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:54 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:55.361891 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:55.362702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:55.368896 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:55.369363 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:55.369789 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:55.370485 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:55.371667 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:55.372087 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:55.505062 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:55.512960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-9778b5aa-0445-4189-8ccf-7bec96f5e41f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.155223 Oct 04 05:52:55.513544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 570/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:55 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:56.536283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:56.536887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:56.543917 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:56.544389 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:56.544819 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:56.545524 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:56.545969 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:56.546409 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:56.672050 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:56.679766 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-17bcf6ea-1ecf-4b33-a352-6f0e505a3fc5 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.147306 Oct 04 05:52:56.680354 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 597/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:56 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:57.702991 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:57.703593 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:57.710020 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:57.710525 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:57.710957 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:57.711632 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:57.712079 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:57.712497 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:57.841008 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:57.848919 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-232bb08e-d996-464b-8a9e-57c71d1e62fc tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.150406 Oct 04 05:52:57.849476 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 571/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:57 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:52:58.870441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:52:58.871066 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:52:58.877848 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:58.878371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:58.878810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:58.879519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:52:58.879973 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:52:58.880397 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:52:59.012687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:52:59.020400 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-23e676e9-a9d8-4a8f-b877-e41b41ed8590 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.153845 Oct 04 05:52:59.020967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 598/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:52:58 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:00.044449 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:00.045051 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:00.047557 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:00.052303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:00.052776 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:00.053205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:00.053929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:00.054400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:00.059424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:00.184021 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:00.192110 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-70fab8cb-2706-4d49-8b9b-756ef8263856 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.152463 Oct 04 05:53:00.192772 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 572/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:00 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:01.213990 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:01.214669 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:01.216497 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:01.217158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:01.222397 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:01.222879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:01.223316 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:01.224003 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:01.224454 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:01.224879 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:01.351919 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:01.360091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a98567fb-8b50-426a-a654-253a814f509b tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.150045 Oct 04 05:53:01.360658 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 599/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:01 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:02.383334 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:02.383968 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:02.390943 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:02.391417 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:02.391850 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:02.392527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:02.392970 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:02.393386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:02.519371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:02.527366 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-1b0e1efe-1980-4528-923f-559234a18612 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.148028 Oct 04 05:53:02.532674 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 573/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:02 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:03.123642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-11298bb5-9395-49e4-a992-c1c728401342 req-c385445b-6303-4617-97c3-44545f910175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "name": "network-vif-plugged", "status": "completed", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:53:03.133654 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-11298bb5-9395-49e4-a992-c1c728401342 req-c385445b-6303-4617-97c3-44545f910175 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:03.134123 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-11298bb5-9395-49e4-a992-c1c728401342 req-c385445b-6303-4617-97c3-44545f910175 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:03.134574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-11298bb5-9395-49e4-a992-c1c728401342 req-c385445b-6303-4617-97c3-44545f910175 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:03.145360 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-11298bb5-9395-49e4-a992-c1c728401342 req-c385445b-6303-4617-97c3-44545f910175 service nova] Creating event network-vif-plugged:7f6ca5a0-87bf-4f8b-b03d-724faba0c205 for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f on hv-cinder-84914 Oct 04 05:53:03.150571 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-11298bb5-9395-49e4-a992-c1c728401342 req-c385445b-6303-4617-97c3-44545f910175 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Oct 04 05:53:03.151158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 600/1173] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:53:03.550349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:03.551630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:03.559378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:03.560343 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:03.561439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:03.562256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:03.562786 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:03.563302 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:03.691390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:03.699829 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e20c316f-f266-4ae0-83ad-eaa40c4d20f7 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.153403 Oct 04 05:53:03.700396 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 574/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:03 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:04.722844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:04.723540 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:04.730845 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:04.731329 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:04.731767 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:04.732468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:04.732938 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:04.733362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:04.860384 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:04.868023 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5b48be65-60e2-4766-99a5-87609ea0ec26 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1258 microversion: 2.1 time: 0.149482 Oct 04 05:53:04.868588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 601/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:04 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:05.890712 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:05.891404 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:05.897774 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:05.898282 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:05.898721 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:05.899410 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:05.899857 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:05.900279 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:06.029686 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:06.037597 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-7b0df7a5-ede6-4a0d-8d5e-89dfa887c106 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1442 microversion: 2.1 time: 0.150742 Oct 04 05:53:06.038186 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 575/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:05 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:06.067357 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:06.067985 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:06.074751 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:06.075259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:06.075689 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:06.076372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:06.076822 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:06.077240 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:06.208072 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:06.217068 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-90240699-a4bf-4ee0-97d9-26d68cd1df61 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1442 microversion: 2.1 time: 0.154668 Oct 04 05:53:06.217671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 602/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:06 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:08.106562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-bd7ec60f-2770-4e44-85ec-5420c433838d req-646748bd-5acc-4f71-88fe-2e3a692c3b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:53:08.116548 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-bd7ec60f-2770-4e44-85ec-5420c433838d req-646748bd-5acc-4f71-88fe-2e3a692c3b1c service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:08.117017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-bd7ec60f-2770-4e44-85ec-5420c433838d req-646748bd-5acc-4f71-88fe-2e3a692c3b1c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:08.117439 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-bd7ec60f-2770-4e44-85ec-5420c433838d req-646748bd-5acc-4f71-88fe-2e3a692c3b1c service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:08.128206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-bd7ec60f-2770-4e44-85ec-5420c433838d req-646748bd-5acc-4f71-88fe-2e3a692c3b1c service nova] Creating event network-changed:7f6ca5a0-87bf-4f8b-b03d-724faba0c205 for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f on hv-cinder-84914 Oct 04 05:53:08.133175 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-bd7ec60f-2770-4e44-85ec-5420c433838d req-646748bd-5acc-4f71-88fe-2e3a692c3b1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Oct 04 05:53:08.133986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 576/1178] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:53:20.303158 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2009651623", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495012344", "security_groups": [{"name": "tempest-secgroup-smoke-1310825236"}], "block_device_mapping_v2": [{"uuid": "0271e4df-199b-4359-8ee5-0ef3fb812e1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79e2bf3e-1f66-495f-8ec9-26b178e13978"}]}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:53:20.313956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:20.314646 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=55 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:20.415662 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.network.neutron [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] validate_networks() for [('79e2bf3e-1f66-495f-8ec9-26b178e13978', None, None, None, None, None)] {{(pid=127392) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 05:53:20.833425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Flavor limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 05:53:20.833844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Image limits 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 05:53:20.834353 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Flavor pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 05:53:20.834759 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Image pref 0:0:0 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 05:53:20.835165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.virt.hardware [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 05:53:20.844524 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:20.845000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:20.845435 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:20.846196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:20.846655 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:20.847080 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:20.863385 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 05:53:20.867334 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.quota [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Getting quotas for user 0c0c0a25340a451b970cc3de8bc05806 and project 45a5869786d843fe9fb5cdb6b3596c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=127392) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 05:53:20.924310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Going to run 1 instances... {{(pid=127392) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 05:53:20.926471 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0271e4df-199b-4359-8ee5-0ef3fb812e1f',volume_size=None,volume_type=None)] {{(pid=127392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 05:53:21.277403 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-557783fa-264f-4457-afa4-fb7dbc3ed002 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.978040 Oct 04 05:53:21.278046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 603/1179] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 4 05:53:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 05:53:21.286897 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=22 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:21.287646 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=46 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:21.292434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-2d785f31-aeb9-49a0-b352-3247e343b49a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:21.293137 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-2d785f31-aeb9-49a0-b352-3247e343b49a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:21.349353 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-2d785f31-aeb9-49a0-b352-3247e343b49a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:21.357611 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-2d785f31-aeb9-49a0-b352-3247e343b49a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1094 microversion: 2.1 time: 0.072273 Oct 04 05:53:21.358201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 577/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:21 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:22.380673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:22.381283 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:22.387611 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:22.388092 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:22.388520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:22.389205 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:22.389652 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:22.390070 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:22.450428 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:22.458350 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8fced9c9-7189-4308-8fa9-1f7aeb2f3080 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1144 microversion: 2.1 time: 0.082039 Oct 04 05:53:22.458918 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 604/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:22 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:23.481372 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:23.482012 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:23.489321 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:23.489801 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:23.490269 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:23.490954 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:23.491400 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:23.491822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:23.822465 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:23.830473 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-568b59e9-87eb-400c-8d1e-c22071660064 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1192 microversion: 2.1 time: 0.353302 Oct 04 05:53:23.833905 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 578/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:23 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1192 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:24.852956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:24.854419 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:24.861671 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:24.868402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:24.868402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:24.868402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:24.868402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:24.868974 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:25.004213 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:25.012576 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-25013056-c0c2-4058-9f20-e494cc17dbab tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1278 microversion: 2.1 time: 0.163628 Oct 04 05:53:25.013243 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 605/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:24 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:25.644715 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-b587d97b-d4d4-4a26-ac80-64b62127d19d req-940bc5f8-3c45-44f1-b6b1-1f82483a7be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613332ae-8dff-42d1-951d-26edf50f86f2", "tag": "c560ca58-da5c-41e9-a8ff-688a557078a4"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:53:25.654569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b587d97b-d4d4-4a26-ac80-64b62127d19d req-940bc5f8-3c45-44f1-b6b1-1f82483a7be8 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:25.655041 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b587d97b-d4d4-4a26-ac80-64b62127d19d req-940bc5f8-3c45-44f1-b6b1-1f82483a7be8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:25.655469 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-b587d97b-d4d4-4a26-ac80-64b62127d19d req-940bc5f8-3c45-44f1-b6b1-1f82483a7be8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:25.666132 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-b587d97b-d4d4-4a26-ac80-64b62127d19d req-940bc5f8-3c45-44f1-b6b1-1f82483a7be8 service nova] Creating event network-changed:c560ca58-da5c-41e9-a8ff-688a557078a4 for instance 613332ae-8dff-42d1-951d-26edf50f86f2 on hv-cinder-84914 Oct 04 05:53:25.671515 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-b587d97b-d4d4-4a26-ac80-64b62127d19d req-940bc5f8-3c45-44f1-b6b1-1f82483a7be8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091532 Oct 04 05:53:25.672139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 579/1184] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:53:26.035244 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:26.035847 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:26.042261 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:26.042739 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:26.043172 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:26.043864 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:26.044313 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:26.044743 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:26.172999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:26.180835 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ff0047c2-caaa-43e0-abdd-93892953af12 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.149441 Oct 04 05:53:26.181398 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 606/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:26 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:27.204658 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:27.205300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:27.211505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:27.211981 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:27.212413 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:27.213095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:27.214028 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:27.214478 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:27.346526 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:27.354727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-5cca5056-3fc3-414a-97d7-68592fe49d77 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.154170 Oct 04 05:53:27.355294 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 580/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:27 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:28.376874 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:28.377492 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:28.383994 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:28.384473 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:28.384913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:28.385610 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:28.386064 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:28.386522 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:28.726569 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:28.734895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-79d14a6a-d67c-4dfc-bd2c-b65212dbbfb2 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.361958 Oct 04 05:53:28.738593 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 607/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:28 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:29.757127 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:29.757725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:29.764273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:29.767568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:29.767568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:29.767568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:29.767568 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:29.767984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:29.894755 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:29.902425 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eea58255-91e3-481a-aa3b-96d4f08f9bbd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.149138 Oct 04 05:53:29.902984 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 581/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:29 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:30.924750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:30.925381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:30.927717 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=2 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:30.928652 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell0:SELECT=6 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:30.933539 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:30.934007 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:30.934494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:30.935150 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:30.935594 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:30.936011 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:31.062599 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:31.070607 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-85dc62fa-8e70-46ee-88b9-9f3a04c78f56 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.149613 Oct 04 05:53:31.071175 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 608/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:30 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:32.093866 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:32.094512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:32.097061 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell0:SELECT=2 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:53:32.101967 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:32.102486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:32.102926 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:32.103609 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:32.104055 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:32.104475 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:32.234544 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:32.242179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-83cff87c-8a51-40af-9515-69d594906f03 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.152550 Oct 04 05:53:32.242749 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 582/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:32 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:33.264216 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:33.264887 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:33.271242 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:33.271714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:33.272146 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:33.272828 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:33.273273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:33.273693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:33.404052 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:33.411633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-d03bf449-3c57-4dfb-9d4f-55c6c0b2b549 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.151238 Oct 04 05:53:33.412186 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 609/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:33 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:34.434373 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:34.434987 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:34.441445 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:34.441928 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:34.442406 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:34.443098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:34.443550 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:34.444244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:34.569310 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:34.576960 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-75f0dcce-b955-4b98-a079-5b9b189fb2b3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.147127 Oct 04 05:53:34.577527 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 583/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:34 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:35.599758 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:35.600370 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:35.607425 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:35.607914 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:35.608358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:35.609079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:35.609533 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:35.609967 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:35.740878 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:35.750500 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b675dc40-4861-40e2-b649-1a8def2a5f68 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.154500 Oct 04 05:53:35.751097 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 610/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:35 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:36.772736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:36.773393 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:36.779882 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:36.780358 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:36.780796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:36.781478 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:36.781927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:36.782375 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:36.909058 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:36.916740 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a6047285-12fc-47a1-825b-248b7f66b2d6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.147922 Oct 04 05:53:36.917314 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 584/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:36 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:53:37.256533 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-91b74afd-5cce-498f-8241-923f858364dd req-7a80351f-bf48-4f06-8ef4-b73d8444bd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613332ae-8dff-42d1-951d-26edf50f86f2", "name": "network-vif-plugged", "status": "completed", "tag": "c560ca58-da5c-41e9-a8ff-688a557078a4"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:53:37.266086 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-91b74afd-5cce-498f-8241-923f858364dd req-7a80351f-bf48-4f06-8ef4-b73d8444bd39 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:37.266627 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-91b74afd-5cce-498f-8241-923f858364dd req-7a80351f-bf48-4f06-8ef4-b73d8444bd39 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:37.267056 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-91b74afd-5cce-498f-8241-923f858364dd req-7a80351f-bf48-4f06-8ef4-b73d8444bd39 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:37.277844 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-91b74afd-5cce-498f-8241-923f858364dd req-7a80351f-bf48-4f06-8ef4-b73d8444bd39 service nova] Creating event network-vif-plugged:c560ca58-da5c-41e9-a8ff-688a557078a4 for instance 613332ae-8dff-42d1-951d-26edf50f86f2 on hv-cinder-84914 Oct 04 05:53:37.283179 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-91b74afd-5cce-498f-8241-923f858364dd req-7a80351f-bf48-4f06-8ef4-b73d8444bd39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030422 Oct 04 05:53:37.283769 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 611/1195] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:53:37.938872 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:37.939486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:37.946265 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:37.946750 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:37.947194 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:37.948405 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:37.948859 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:37.949289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:38.074340 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:38.081904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4cfa4013-4b69-4476-8f5c-95c22d1a3a9a tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.146893 Oct 04 05:53:38.082501 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 585/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:37 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:39.105694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:39.106414 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:39.113252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:39.113732 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:39.114189 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:39.114884 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:39.115341 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:39.115762 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:39.247308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:39.255145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-b8c2a2bd-e5c6-4b64-a301-8d59a1db7e46 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1266 microversion: 2.1 time: 0.154097 Oct 04 05:53:39.255709 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 612/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:39 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:40.276979 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:40.277513 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:40.284128 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:40.284600 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:40.285029 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:40.285704 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:40.286163 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:40.286594 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:40.421244 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:40.428912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-f1096979-cc2b-43ad-be01-1f185e68905f tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1453 microversion: 2.1 time: 0.155902 Oct 04 05:53:40.429471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 586/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:40 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:53:40.451272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:53:40.451980 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:53:40.458469 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:40.458951 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:40.459388 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:40.460077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:40.460536 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:40.460962 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:40.589019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:53:40.596673 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-917a9d90-338e-4f23-9ebb-16760ddda5d3 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1453 microversion: 2.1 time: 0.149396 Oct 04 05:53:40.597234 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 613/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:53:40 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:53:42.568017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-efc216f8-c8e1-4143-8f73-996db9ef41c0 req-aee59efb-27e4-45be-aea5-681e9e8fac1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613332ae-8dff-42d1-951d-26edf50f86f2", "tag": "c560ca58-da5c-41e9-a8ff-688a557078a4"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:53:42.578161 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-efc216f8-c8e1-4143-8f73-996db9ef41c0 req-aee59efb-27e4-45be-aea5-681e9e8fac1b service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:53:42.578663 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-efc216f8-c8e1-4143-8f73-996db9ef41c0 req-aee59efb-27e4-45be-aea5-681e9e8fac1b service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:53:42.579091 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-efc216f8-c8e1-4143-8f73-996db9ef41c0 req-aee59efb-27e4-45be-aea5-681e9e8fac1b service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:53:42.590616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-efc216f8-c8e1-4143-8f73-996db9ef41c0 req-aee59efb-27e4-45be-aea5-681e9e8fac1b service nova] Creating event network-changed:c560ca58-da5c-41e9-a8ff-688a557078a4 for instance 613332ae-8dff-42d1-951d-26edf50f86f2 on hv-cinder-84914 Oct 04 05:53:42.595606 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-efc216f8-c8e1-4143-8f73-996db9ef41c0 req-aee59efb-27e4-45be-aea5-681e9e8fac1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084345 Oct 04 05:53:42.596537 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 587/1200] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:55:05.532482 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:05.533237 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=58 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:05.538067 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:05.538653 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:05.545228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:05.545702 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:05.546164 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:05.546842 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:05.547292 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:05.547714 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:05.570909 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lazy-loading 'flavor' on Instance uuid 4b50e0fa-dbc3-4053-98cf-7291cfaab92f {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:55:05.844230 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fff2c3e7-b75e-4b06-b420-350c06a76e78 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "POST /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f/action" status: 202 len: 0 microversion: 2.1 time: 0.313391 Oct 04 05:55:05.844827 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 614/1201] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:55:05 2022] POST /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:55:05.851798 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=24 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:05.852491 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=52 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:05.853589 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 05:55:05.853735 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Tue Oct 4 05:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f (ip 10.222.0.26) !!! Oct 04 05:55:05.854826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 05:55:05.855459 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Tue Oct 4 05:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f (ip 10.222.0.26) !!! Oct 04 05:55:05.861225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:05.862767 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:05.872067 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:05.878918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:05.878918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:05.878918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:05.878918 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:05.879346 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:06.010700 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:06.018518 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e8f6c168-9af4-47e8-989d-374b9ede3752 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.169046 Oct 04 05:55:06.019095 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 588/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:05 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:07.047993 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:07.048687 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:07.054902 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:07.055387 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:07.055825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:07.056520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:07.057008 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:07.057437 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:07.185932 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:07.193679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ffe0f9bb-f2dd-44e1-a6f8-a15d56aad852 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.151110 Oct 04 05:55:07.194268 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 615/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:07 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:08.216664 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:08.217203 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:08.223585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:08.224083 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:08.224512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:08.225192 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:08.225630 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:08.226046 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:08.349759 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:08.357362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-748d79d5-04d8-4216-b83d-5ae43f4d20ae tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.144623 Oct 04 05:55:08.357930 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 589/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:08 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:09.380488 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:09.381110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:09.388185 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:09.388666 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:09.389108 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:09.389802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:09.390298 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:09.390727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:09.519371 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:09.527151 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-387e20c3-abdf-49a1-878b-95a83574a209 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.150547 Oct 04 05:55:09.527723 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 616/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:09 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:10.550876 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:10.551666 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:10.558362 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:10.558845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:10.559281 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:10.559986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:10.560434 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:10.560856 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:10.801486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:10.813754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:10.813754 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:10.814389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-aabb50cf-cf0f-41b9-9cec-4abef393e660 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.263501 Oct 04 05:55:10.814389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 590/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:10 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:10.816273 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-01b1bf6b-2c81-40c1-8e11-6d37c79c05a2 req-3cf0c60a-5c29-4b3d-97c9-1dbbc551b2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613332ae-8dff-42d1-951d-26edf50f86f2", "tag": "c560ca58-da5c-41e9-a8ff-688a557078a4"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:10.818101 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:10.818811 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:10.819434 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:10.820572 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:10.821224 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:10.821940 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:10.826787 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-01b1bf6b-2c81-40c1-8e11-6d37c79c05a2 req-3cf0c60a-5c29-4b3d-97c9-1dbbc551b2e5 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:10.827256 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-01b1bf6b-2c81-40c1-8e11-6d37c79c05a2 req-3cf0c60a-5c29-4b3d-97c9-1dbbc551b2e5 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:10.827683 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-01b1bf6b-2c81-40c1-8e11-6d37c79c05a2 req-3cf0c60a-5c29-4b3d-97c9-1dbbc551b2e5 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:10.839086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-01b1bf6b-2c81-40c1-8e11-6d37c79c05a2 req-3cf0c60a-5c29-4b3d-97c9-1dbbc551b2e5 service nova] Creating event network-changed:c560ca58-da5c-41e9-a8ff-688a557078a4 for instance 613332ae-8dff-42d1-951d-26edf50f86f2 on hv-cinder-84914 Oct 04 05:55:10.845348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-01b1bf6b-2c81-40c1-8e11-6d37c79c05a2 req-3cf0c60a-5c29-4b3d-97c9-1dbbc551b2e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032765 Oct 04 05:55:10.846264 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 591/1207] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:55:10.850862 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:55:11.138401 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7a9074a0-327a-4b1c-91dc-55b4870c5499 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 204 len: 0 microversion: 2.1 time: 0.333593 Oct 04 05:55:11.138998 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 617/1208] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:55:10 2022] DELETE /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:55:11.148252 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:11.148956 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:11.155690 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:11.156173 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:11.156613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:11.157374 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:11.157825 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:11.158277 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:11.289773 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:11.297559 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-90a64a6f-4fbd-40e2-9e3b-3556de365201 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1577 microversion: 2.1 time: 0.153933 Oct 04 05:55:11.298233 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 592/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:11 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:11.835764 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:11.836383 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:11.843235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:11.843713 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:11.844141 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:11.844825 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:11.845272 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:11.845698 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:11.975760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:11.984020 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-ae037f52-0a87-4f8d-b342-965a2f058317 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.152599 Oct 04 05:55:11.984574 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 618/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:11 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:12.321080 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:12.321745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:12.328706 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:12.329180 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:12.329613 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:12.330327 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:12.330775 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:12.331199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:12.499633 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:12.507407 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dd71f262-de02-478f-a77a-e9b61eaffb87 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1577 microversion: 2.1 time: 0.190444 Oct 04 05:55:12.507977 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 593/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:12 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:13.007299 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:13.007820 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:13.014252 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:13.014727 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:13.015160 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:13.015882 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:13.016331 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:13.016750 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:13.147942 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:13.155810 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-4b0acbde-c6f8-48b2-b891-bd0eb33f5f07 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.152436 Oct 04 05:55:13.156372 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 619/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:13 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:13.531454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:13.532060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:13.538390 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:13.538862 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:13.539296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:13.539980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:13.540424 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:13.540845 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:13.615560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:13.620754 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d8c975b1-b3d5-4451-86b3-96b600b1e203 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1391 microversion: 2.1 time: 0.093693 Oct 04 05:55:13.621681 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 594/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:13 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:13.664147 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-671f536a-2d77-4698-acb8-de73695af828 req-6584db4b-671e-4c1a-9224-1a1ffc566c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613332ae-8dff-42d1-951d-26edf50f86f2", "name": "network-vif-deleted", "tag": "c560ca58-da5c-41e9-a8ff-688a557078a4"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:13.674196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-671f536a-2d77-4698-acb8-de73695af828 req-6584db4b-671e-4c1a-9224-1a1ffc566c44 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:13.674665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-671f536a-2d77-4698-acb8-de73695af828 req-6584db4b-671e-4c1a-9224-1a1ffc566c44 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:13.675091 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-671f536a-2d77-4698-acb8-de73695af828 req-6584db4b-671e-4c1a-9224-1a1ffc566c44 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:13.686362 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-671f536a-2d77-4698-acb8-de73695af828 req-6584db4b-671e-4c1a-9224-1a1ffc566c44 service nova] Creating event network-vif-deleted:c560ca58-da5c-41e9-a8ff-688a557078a4 for instance 613332ae-8dff-42d1-951d-26edf50f86f2 on hv-cinder-84914 Oct 04 05:55:13.692003 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-671f536a-2d77-4698-acb8-de73695af828 req-6584db4b-671e-4c1a-9224-1a1ffc566c44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Oct 04 05:55:13.692580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 620/1214] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:55:14.179382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:14.180190 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:14.186882 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:14.187364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:14.187799 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:14.188493 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:14.188941 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:14.189364 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:14.319076 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:14.327894 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-eb2958d1-9d1e-406f-b538-abcd17dfe058 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.152623 Oct 04 05:55:14.328463 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 595/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:14 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:14.645410 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:14.646093 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:14.652684 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:14.653157 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:14.653589 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:14.654310 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:14.654792 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:14.655214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:14.686468 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:14.686945 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:14.687377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:14.687817 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lazy-loading 'fault' on Instance uuid 613332ae-8dff-42d1-951d-26edf50f86f2 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:55:14.732206 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:14.740929 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-cbe1c8b5-7d76-43ef-8ae0-b6a45c5dbfa6 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 200 len: 1230 microversion: 2.1 time: 0.099684 Oct 04 05:55:14.741494 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 621/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:14 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:15.350745 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:15.351359 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:15.358472 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:15.358953 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:15.359421 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:15.360109 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:15.360561 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:15.360986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:15.491903 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:15.500410 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a39fec93-147f-4c19-ae20-461d32305e7e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.153696 Oct 04 05:55:15.500974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 596/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:15 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:15.764445 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:15.765173 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 613332ae-8dff-42d1-951d-26edf50f86f2] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:15.771677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:15.772145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:15.772573 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:15.773249 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:15.773694 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:15.774111 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:15.787430 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.wsgi [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] HTTP exception thrown: Instance 613332ae-8dff-42d1-951d-26edf50f86f2 could not be found. Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Request method failure captured: Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: request: GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 HTTP/1.1 Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept: application/json Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Accept-Encoding: identity Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Connection: close Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Length: 0 Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Content-Type: application/json Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Host: 10.222.0.26 Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Openstack-System-Scope: None Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: User-Agent: python-urllib3/1.26.12 Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Auth-Token: gAAAAABjO8j2XLetu_xQeSFC3ZJ8rJxQczD8pdMbXR-N9J4HutGwbTU487EhzxA_7w3LDC5MmzY0zBpDZPO9sjsItlt6kEYuz1UKPSXoV9L7njsmrXfL81d_uWyTJyMd6LGpaSb64zsatIYRJif9cOGm5ViiUxbfuZ2iC6fi-7HHWfCQB1QpJog Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Id: None Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Domain-Name: None Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Identity-Status: Confirmed Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Is-Admin-Project: True Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Id: default Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Domain-Name: Default Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Project-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Role: member,reader Oct 04 05:55:15.789029 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Roles: member,reader Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_45a5869786d843fe9fb5cdb6b3596c2f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}] Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Id: default Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Domain-Name: Default Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Id: 0c0c0a25340a451b970cc3de8bc05806 Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: X-User-Name: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: method: > Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: exception: Instance 613332ae-8dff-42d1-951d-26edf50f86f2 could not be found. Oct 04 05:55:15.790866 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: action_args: {'id': '613332ae-8dff-42d1-951d-26edf50f86f2'} Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613332ae-8dff-42d1-951d-26edf50f86f2 could not be found. Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:55:15.792520 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613332ae-8dff-42d1-951d-26edf50f86f2 could not be found. Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613332ae-8dff-42d1-951d-26edf50f86f2 could not be found. Oct 04 05:55:15.794270 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: ERROR nova.api.openstack.wsgi Oct 04 05:55:15.795774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Returning 404 to user: Instance 613332ae-8dff-42d1-951d-26edf50f86f2 could not be found. {{(pid=127392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:55:15.795774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-05bf2ad9-517e-4d1d-b76b-6c7874fe9287 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2" status: 404 len: 111 microversion: 2.1 time: 0.029938 Oct 04 05:55:15.795774 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 622/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:15 2022] GET /compute/v2.1/servers/613332ae-8dff-42d1-951d-26edf50f86f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:55:16.523283 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:16.527225 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:16.530911 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:16.531389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:16.531824 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:16.532517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:16.532969 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:16.533438 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:16.771999 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:16.779869 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-e7d6378c-21a3-406b-828c-09fae300241d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.260437 Oct 04 05:55:16.780454 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 597/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:16 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:55:17.802638 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:17.803241 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:17.809665 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:17.814881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:17.814881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:17.814881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:17.814881 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:17.815291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:17.941169 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:17.949228 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-dd864ce9-4d60-460c-a270-9c01ffb9d915 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.150410 Oct 04 05:55:17.949786 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 623/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:17 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:18.973678 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:18.974310 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:18.980758 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:18.981230 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:18.981657 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:18.982367 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:18.982810 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:18.983226 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:19.160740 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:19.161343 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:19.178788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:19.179612 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:19.180635 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:19.181679 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:19.182148 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:19.185684 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:19.188924 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:19.194213 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-678d69a5-5cea-4185-9370-6679eaf2abb4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1567 microversion: 2.1 time: 0.225161 Oct 04 05:55:19.195460 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 598/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:18 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:19.200355 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-5779c7f4-8249-4043-9334-ac9d7fa4b40a req-3b6ff494-1e13-4956-aff8-970ae1f7ba3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7", "tag": "f35de6bd-faf9-47cd-8910-fb186f4a737c"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:19.211274 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-5779c7f4-8249-4043-9334-ac9d7fa4b40a req-3b6ff494-1e13-4956-aff8-970ae1f7ba3e service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:19.213556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-5779c7f4-8249-4043-9334-ac9d7fa4b40a req-3b6ff494-1e13-4956-aff8-970ae1f7ba3e service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:19.213556 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-5779c7f4-8249-4043-9334-ac9d7fa4b40a req-3b6ff494-1e13-4956-aff8-970ae1f7ba3e service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:19.223040 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:55:19.224542 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-5779c7f4-8249-4043-9334-ac9d7fa4b40a req-3b6ff494-1e13-4956-aff8-970ae1f7ba3e service nova] Creating event network-changed:f35de6bd-faf9-47cd-8910-fb186f4a737c for instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 on hv-cinder-84914 Oct 04 05:55:19.230228 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-5779c7f4-8249-4043-9334-ac9d7fa4b40a req-3b6ff494-1e13-4956-aff8-970ae1f7ba3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033167 Oct 04 05:55:19.231098 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 599/1222] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:55:19.537588 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-8a0204b2-8d63-4dc0-91fb-188a6892dbb5 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 204 len: 0 microversion: 2.1 time: 0.381038 Oct 04 05:55:19.538193 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 624/1223] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:55:19 2022] DELETE /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:55:19.547066 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:19.547766 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:19.555214 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:19.556115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:19.556966 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:19.557972 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:19.558688 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:19.559365 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:19.698642 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:19.706296 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-43200ecd-61e1-4e4b-9bb7-422780336809 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1578 microversion: 2.1 time: 0.163720 Oct 04 05:55:19.707088 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 600/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:19 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:20.221579 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:20.222238 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:20.228802 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.229291 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.229766 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.230505 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.230956 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.231441 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.361247 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:20.369560 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5e254eba-dbbb-4872-a65d-694658d10859 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1568 microversion: 2.1 time: 0.152809 Oct 04 05:55:20.370127 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 625/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:20 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:20.391902 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:20.392487 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:20.398929 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.399401 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.399830 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.400500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.400940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.401349 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.431037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127393) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 05:55:20.637826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-80e3f913-9dda-4948-a408-f4375ce7b4c0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "POST /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f/action" status: 202 len: 0 microversion: 2.1 time: 0.250160 Oct 04 05:55:20.638539 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 601/1226] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 4 05:55:20 2022] POST /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:55:20.647117 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:20.647760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:20.653799 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.654356 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.654760 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.655462 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.655922 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.656354 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.661065 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:20.730680 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:20.731480 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:20.738229 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.738812 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.739316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.740201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:20.740748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:20.741378 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:20.788544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:20.796604 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-1a062ade-b086-4739-be60-2a032b18e397 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1576 microversion: 2.1 time: 0.153315 Oct 04 05:55:20.797233 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 626/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:20 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:20.949132 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:20.958252 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-89621560-3d30-4e9e-a994-a481e206e1a9 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1578 microversion: 2.1 time: 0.231656 Oct 04 05:55:20.958923 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 602/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:20 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1578 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 05:55:21.819100 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:21.820095 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:21.826563 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:21.827043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:21.827479 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:21.828181 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:21.828631 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:21.829352 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:21.981178 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:21.981904 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:21.982659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:21.989448 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:21.989692 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-977bb836-eccf-4e7f-9707-e524f2dcf5fa tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1576 microversion: 2.1 time: 0.174531 Oct 04 05:55:21.990500 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:21.990633 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 627/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:21 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:21.990846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:21.991636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:21.992178 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:21.992694 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:22.165538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:22.173381 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-8fbb9788-420d-4ea5-9a09-f9a8b7b86a84 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1459 microversion: 2.1 time: 0.195713 Oct 04 05:55:22.173940 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 603/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:21 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1459 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:22.307342 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-c89e0888-a974-4572-aeb8-f102aeba3bc3 req-38a46690-17e9-4d71-b364-8772e1404d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7", "name": "network-vif-deleted", "tag": "f35de6bd-faf9-47cd-8910-fb186f4a737c"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:22.317079 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-c89e0888-a974-4572-aeb8-f102aeba3bc3 req-38a46690-17e9-4d71-b364-8772e1404d74 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:22.317586 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-c89e0888-a974-4572-aeb8-f102aeba3bc3 req-38a46690-17e9-4d71-b364-8772e1404d74 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:22.318019 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-c89e0888-a974-4572-aeb8-f102aeba3bc3 req-38a46690-17e9-4d71-b364-8772e1404d74 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:22.329700 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-c89e0888-a974-4572-aeb8-f102aeba3bc3 req-38a46690-17e9-4d71-b364-8772e1404d74 service nova] Creating event network-vif-deleted:f35de6bd-faf9-47cd-8910-fb186f4a737c for instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 on hv-cinder-84914 Oct 04 05:55:22.334465 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-c89e0888-a974-4572-aeb8-f102aeba3bc3 req-38a46690-17e9-4d71-b364-8772e1404d74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030837 Oct 04 05:55:22.335044 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 628/1231] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:55:23.016736 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:23.017451 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:23.023993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:23.024471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:23.024909 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:23.025878 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:23.026371 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:23.026794 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:23.160520 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:23.164136 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:23.168744 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-cf4052bd-9abe-41e8-8aac-ded6276a6a14 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1518 microversion: 2.1 time: 0.156087 Oct 04 05:55:23.169306 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 604/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:23 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:23.198046 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:23.198859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:23.205013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:23.205431 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:23.205859 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:23.206591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:23.207043 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:23.207462 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:23.238596 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:23.239061 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:23.239492 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:23.239934 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lazy-loading 'fault' on Instance uuid 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:55:23.280267 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c0c0a25340a451b970cc3de8bc05806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a5869786d843fe9fb5cdb6b3596c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:23.288801 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5d72fb8e-5f27-4d6a-8540-68f15a53f683 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 200 len: 1230 microversion: 2.1 time: 0.095771 Oct 04 05:55:23.289358 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 629/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:23 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:23.834360 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-a54e9d6d-8a67-4c51-8f8d-0b64aba1ad02 req-070fc24e-f9ed-4b7f-94d3-50090a1b03f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:23.844701 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-a54e9d6d-8a67-4c51-8f8d-0b64aba1ad02 req-070fc24e-f9ed-4b7f-94d3-50090a1b03f7 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:23.845171 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-a54e9d6d-8a67-4c51-8f8d-0b64aba1ad02 req-070fc24e-f9ed-4b7f-94d3-50090a1b03f7 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:23.845595 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-a54e9d6d-8a67-4c51-8f8d-0b64aba1ad02 req-070fc24e-f9ed-4b7f-94d3-50090a1b03f7 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:23.857205 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.compute.server_external_events [req-a54e9d6d-8a67-4c51-8f8d-0b64aba1ad02 req-070fc24e-f9ed-4b7f-94d3-50090a1b03f7 service nova] Unable to find a host for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f. Dropping event network-vif-unplugged {{(pid=127393) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 05:55:23.858350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-a54e9d6d-8a67-4c51-8f8d-0b64aba1ad02 req-070fc24e-f9ed-4b7f-94d3-50090a1b03f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086058 Oct 04 05:55:23.859134 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 605/1234] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 05:55:24.193110 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:24.193642 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:24.200327 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:24.200905 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:24.201218 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:24.201899 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:24.202366 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:24.202785 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:24.313840 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:24.314489 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:24.321231 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:24.321722 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:24.322133 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:24.322841 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:24.323284 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:24.323709 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:24.331305 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:24.337585 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] HTTP exception thrown: Instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 could not be found. Oct 04 05:55:24.339263 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-e6084d45-fd0f-4abc-993c-37c984dd0730 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.150009 Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Request method failure captured: Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 HTTP/1.1 Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8j2XLetu_xQeSFC3ZJ8rJxQczD8pdMbXR-N9J4HutGwbTU487EhzxA_7w3LDC5MmzY0zBpDZPO9sjsItlt6kEYuz1UKPSXoV9L7njsmrXfL81d_uWyTJyMd6LGpaSb64zsatIYRJif9cOGm5ViiUxbfuZ2iC6fi-7HHWfCQB1QpJog Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:55:24.339601 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_45a5869786d843fe9fb5cdb6b3596c2f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}] Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 0c0c0a25340a451b970cc3de8bc05806 Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 could not be found. Oct 04 05:55:24.348099 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7'} Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 could not be found. Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:55:24.349569 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 could not be found. Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 could not be found. Oct 04 05:55:24.351826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:24.355413 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 630/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:24 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:24.355517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Returning 404 to user: Instance 61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:55:24.355517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b9216dae-5ada-4f20-9986-b3b8a760d87b tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7" status: 404 len: 111 microversion: 2.1 time: 0.031656 Oct 04 05:55:24.355517 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 606/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:24 2022] GET /compute/v2.1/servers/61ee2df4-9d1a-47e3-96f6-4f9d5afd7cc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:55:25.362747 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:25.363532 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:25.370069 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:25.370632 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:25.371077 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:25.371779 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:25.372231 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:25.372661 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:25.390471 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:25.392258 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:25.398785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:25.399271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:25.399703 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:25.400399 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:25.400846 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:25.401269 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:25.415259 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] HTTP exception thrown: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Request method failure captured: Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: DELETE /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 HTTP/1.1 Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8j2XLetu_xQeSFC3ZJ8rJxQczD8pdMbXR-N9J4HutGwbTU487EhzxA_7w3LDC5MmzY0zBpDZPO9sjsItlt6kEYuz1UKPSXoV9L7njsmrXfL81d_uWyTJyMd6LGpaSb64zsatIYRJif9cOGm5ViiUxbfuZ2iC6fi-7HHWfCQB1QpJog Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:55:25.416848 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_45a5869786d843fe9fb5cdb6b3596c2f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}] Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 0c0c0a25340a451b970cc3de8bc05806 Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.418760 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '517a5b7f-76e0-4888-8e50-c6972ee30554'} Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:55:25.419771 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.421408 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.423765 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Returning 404 to user: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:55:25.424627 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0a93eb19-2b6a-4948-b8a5-0417190681dd tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 404 len: 111 microversion: 2.1 time: 0.038292 Oct 04 05:55:25.425189 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 607/1237] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:55:25 2022] DELETE /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 05:55:25.433315 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:25.434217 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] [instance: 517a5b7f-76e0-4888-8e50-c6972ee30554] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:25.440796 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:25.441271 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:25.441702 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:25.442474 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:25.442927 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:25.443350 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:25.457885 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] HTTP exception thrown: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Request method failure captured: Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 HTTP/1.1 Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8j2XLetu_xQeSFC3ZJ8rJxQczD8pdMbXR-N9J4HutGwbTU487EhzxA_7w3LDC5MmzY0zBpDZPO9sjsItlt6kEYuz1UKPSXoV9L7njsmrXfL81d_uWyTJyMd6LGpaSb64zsatIYRJif9cOGm5ViiUxbfuZ2iC6fi-7HHWfCQB1QpJog Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:55:25.459199 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_45a5869786d843fe9fb5cdb6b3596c2f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/45a5869786d843fe9fb5cdb6b3596c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/45a5869786d843fe9fb5cdb6b3596c2f"}]}] Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: 45a5869786d843fe9fb5cdb6b3596c2f Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048575997 Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 0c0c0a25340a451b970cc3de8bc05806 Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-TestVolumeBootPattern-1048575997-project Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.460727 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '517a5b7f-76e0-4888-8e50-c6972ee30554'} Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:55:25.464965 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. Oct 04 05:55:25.466737 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:55:25.468238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Returning 404 to user: Instance 517a5b7f-76e0-4888-8e50-c6972ee30554 could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:55:25.468238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-dcf2e6e4-3f6d-4e29-9849-17d81c93907e tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554" status: 404 len: 111 microversion: 2.1 time: 0.030997 Oct 04 05:55:25.468238 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 608/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:25 2022] GET /compute/v2.1/servers/517a5b7f-76e0-4888-8e50-c6972ee30554 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:55:25.512808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:25.521094 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-c1e204b5-8386-4f49-aaa0-0a2cd4054301 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.162188 Oct 04 05:55:25.521658 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 631/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:25 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:26.543078 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:26.543672 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:26.550032 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:26.550533 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:26.550966 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:26.551645 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:26.552086 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:26.552503 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:26.686208 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:26.693961 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-b2966e23-5cba-4e36-9400-43892e4c722e tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.154721 Oct 04 05:55:26.694584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 609/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:26 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:26.954000 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-a76b95c1-1d68-4acc-a1bd-4722e82fa652 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] Calling method '.version_select at 0x7f04865a1310>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:27.023976 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-a76b95c1-1d68-4acc-a1bd-4722e82fa652 tempest-TestVolumeBootPattern-1048575997 tempest-TestVolumeBootPattern-1048575997-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495012344" status: 202 len: 0 microversion: 2.1 time: 0.074313 Oct 04 05:55:27.024559 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 632/1241] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 4 05:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495012344 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 05:55:27.717017 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:27.717728 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:27.724512 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:27.724988 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:27.725429 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:27.726108 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:27.726584 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:27.727007 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:27.947980 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:27.956461 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-36d5c242-ae27-4e9c-b7e5-2181e03060e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.243290 Oct 04 05:55:27.957037 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 610/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:27 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:28.980377 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:28.981790 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:28.989693 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:28.990402 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:28.990843 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:28.991701 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:28.992153 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:28.992575 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:29.136553 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:29.144429 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0cf5c67f-a9a5-41e8-bd97-1f791921a5da tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.168011 Oct 04 05:55:29.145026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 633/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:28 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:30.168262 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:30.168835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:30.175636 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:30.176126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:30.176562 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:30.177303 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:30.177936 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:30.178560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:30.454115 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:30.462232 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0e3ba138-9263-4b9a-8207-b40bb09643a1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.297883 Oct 04 05:55:30.462986 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 611/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:30 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:31.485118 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:31.485745 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:31.492555 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:31.493039 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:31.493478 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:31.494232 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:31.494663 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:31.495088 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:31.920634 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:31.929012 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-0622a928-9e12-486f-9838-e21d943bdee4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.448089 Oct 04 05:55:31.929658 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 634/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:31 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:32.953659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:32.954949 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:32.961361 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:32.962118 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:32.962575 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:32.963254 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:32.963697 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:32.964116 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:33.094201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:33.101974 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-31bd0e94-4da6-4347-8109-71203f823ba0 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.152851 Oct 04 05:55:33.104358 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 612/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:32 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:34.132209 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:34.132913 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:34.148436 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:34.150674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:34.150674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:34.150674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:34.150674 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:34.151346 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:34.294935 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:34.302877 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-abe898ac-dc07-4dac-9d2c-91e288d99cd1 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.181977 Oct 04 05:55:34.303446 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 635/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:34 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:35.326538 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:35.327168 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:35.333536 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:35.334013 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:35.334481 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:35.335168 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:35.335614 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:35.336036 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:35.478818 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:35.486486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-0bdccb25-e33c-4442-89fe-a7bc75ee9d00 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.163816 Oct 04 05:55:35.487052 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 613/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:35 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:35.918807 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-c8ece545-12b6-42a5-aa48-e138a23bfcb9 req-07401fd5-40a1-4fab-a0ec-3574aa58bbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "name": "network-vif-plugged", "status": "completed", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:55:35.925748 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:35.931239 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-c8ece545-12b6-42a5-aa48-e138a23bfcb9 req-07401fd5-40a1-4fab-a0ec-3574aa58bbc8 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:35.931808 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-c8ece545-12b6-42a5-aa48-e138a23bfcb9 req-07401fd5-40a1-4fab-a0ec-3574aa58bbc8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:35.932308 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-c8ece545-12b6-42a5-aa48-e138a23bfcb9 req-07401fd5-40a1-4fab-a0ec-3574aa58bbc8 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:35.945580 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-c8ece545-12b6-42a5-aa48-e138a23bfcb9 req-07401fd5-40a1-4fab-a0ec-3574aa58bbc8 service nova] Creating event network-vif-plugged:7f6ca5a0-87bf-4f8b-b03d-724faba0c205 for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f on hv-cinder-84914 Oct 04 05:55:35.951277 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-c8ece545-12b6-42a5-aa48-e138a23bfcb9 req-07401fd5-40a1-4fab-a0ec-3574aa58bbc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036221 Oct 04 05:55:35.951970 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 636/1249] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:55:36.509222 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:36.509748 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:36.512057 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:55:36.516822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:36.518884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:36.518884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:36.518884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:36.518884 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:36.519456 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:36.647831 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:36.655616 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-4da28296-28b0-4a47-a6b2-d1bdafd951df tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.150372 Oct 04 05:55:36.656880 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 614/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:36 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:37.680616 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:37.681300 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:37.688519 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:37.689026 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:37.689456 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:37.693083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:37.693083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:37.693083 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:37.820697 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:37.830048 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-fdc88c15-e859-42f5-bb44-0e1390b59436 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1574 microversion: 2.1 time: 0.154750 Oct 04 05:55:37.830656 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 637/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:37 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:55:38.852835 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:55:38.853453 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:55:38.859826 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:38.860300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:38.860728 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:38.861403 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:55:38.861849 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:55:38.862382 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:55:38.993890 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:55:39.002018 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-c8e74482-830f-46a7-84e1-3596aa229ac9 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1561 microversion: 2.1 time: 0.153066 Oct 04 05:55:39.002583 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 615/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:55:38 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:56:54.169991 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_api:SELECT=3 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:56:54.171343 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG dbcounter [-] [127392] Writing DB stats nova_cell1:SELECT=58 {{(pid=127392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:56:54.176045 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_api:SELECT=3 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:56:54.182357 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG dbcounter [-] [127393] Writing DB stats nova_cell1:SELECT=50 {{(pid=127393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 05:56:54.182503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 05:56:54.182503 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: Tue Oct 4 05:56:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f (ip 10.222.0.26) !!! Oct 04 05:56:54.187381 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:56:54.188201 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [req-26367eb5-9a19-4ae9-9c1c-8db71f6d702f req-be9afccb-609b-42a5-b3ac-afcf8d3750c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:56:54.191554 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:56:54.205060 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-26367eb5-9a19-4ae9-9c1c-8db71f6d702f req-be9afccb-609b-42a5-b3ac-afcf8d3750c3 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:54.210348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-26367eb5-9a19-4ae9-9c1c-8db71f6d702f req-be9afccb-609b-42a5-b3ac-afcf8d3750c3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:54.210348 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [req-26367eb5-9a19-4ae9-9c1c-8db71f6d702f req-be9afccb-609b-42a5-b3ac-afcf8d3750c3 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:54.212273 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:54.212761 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:54.213196 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:54.213895 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:54.214367 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:54.214788 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:54.226249 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.compute.server_external_events [req-26367eb5-9a19-4ae9-9c1c-8db71f6d702f req-be9afccb-609b-42a5-b3ac-afcf8d3750c3 service nova] Creating event network-changed:7f6ca5a0-87bf-4f8b-b03d-724faba0c205 for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f on hv-cinder-84914 Oct 04 05:56:54.231844 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [req-26367eb5-9a19-4ae9-9c1c-8db71f6d702f req-be9afccb-609b-42a5-b3ac-afcf8d3750c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057881 Oct 04 05:56:54.234560 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 616/1253] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:56:54.250590 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Going to try to terminate instance {{(pid=127392) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 05:56:54.593265 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-7d01c7c8-3fb6-4922-93a7-62166149667c tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 204 len: 0 microversion: 2.1 time: 0.425002 Oct 04 05:56:54.594165 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 638/1254] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 4 05:56:54 2022] DELETE /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 05:56:54.603316 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:56:54.610912 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:56:54.611139 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:54.611586 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:54.612025 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:54.612725 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:54.613179 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:54.613662 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:54.745520 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:56:54.753785 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-58ef329f-094b-4a60-aeb7-e107892971e4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1448 microversion: 2.1 time: 0.155106 Oct 04 05:56:54.754389 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 617/1255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:56:54 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:56:55.777733 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:56:55.778458 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:56:55.785512 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:55.785999 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:55.786457 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:55.787145 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:55.787591 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:55.788013 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:55.927150 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:56:55.935006 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-435fa78a-f2fa-46fc-aaf7-7fbd18d1738f tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1448 microversion: 2.1 time: 0.161482 Oct 04 05:56:55.935639 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 639/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:56:55 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:56:56.957720 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:56:56.958289 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:56:56.964793 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:56.965266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:56.965698 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:56.966418 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:56.966861 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:56.967300 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:57.148468 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:56:57.156206 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a43d98bb-26b1-4dfa-8d2f-29e4e5065fe4 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1448 microversion: 2.1 time: 0.202464 Oct 04 05:56:57.157505 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 618/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:56:56 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1448 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:56:57.184677 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [req-5e91380b-ec4f-4371-8183-1269e19fb544 req-ea351102-464d-43c7-a5c1-67a5d59b6f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b50e0fa-dbc3-4053-98cf-7291cfaab92f", "name": "network-vif-deleted", "tag": "7f6ca5a0-87bf-4f8b-b03d-724faba0c205"}]} {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 05:56:57.194544 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-5e91380b-ec4f-4371-8183-1269e19fb544 req-ea351102-464d-43c7-a5c1-67a5d59b6f70 service nova] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:57.196259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-5e91380b-ec4f-4371-8183-1269e19fb544 req-ea351102-464d-43c7-a5c1-67a5d59b6f70 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:57.196259 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [req-5e91380b-ec4f-4371-8183-1269e19fb544 req-ea351102-464d-43c7-a5c1-67a5d59b6f70 service nova] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:57.206933 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.compute.server_external_events [req-5e91380b-ec4f-4371-8183-1269e19fb544 req-ea351102-464d-43c7-a5c1-67a5d59b6f70 service nova] Creating event network-vif-deleted:7f6ca5a0-87bf-4f8b-b03d-724faba0c205 for instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f on hv-cinder-84914 Oct 04 05:56:57.211868 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [req-5e91380b-ec4f-4371-8183-1269e19fb544 req-ea351102-464d-43c7-a5c1-67a5d59b6f70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030800 Oct 04 05:56:57.212376 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 640/1258] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 4 05:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 05:56:58.180816 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:56:58.181420 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:56:58.187670 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:58.191415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:58.191415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:58.191415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:58.191415 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:58.191822 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:58.255900 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.policy [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127393) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:56:58.263294 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-d7797e99-7d56-46bc-afc1-cc3ca356bb4d tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1218 microversion: 2.1 time: 0.086391 Oct 04 05:56:58.264157 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 619/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:56:58 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:56:59.286194 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:56:59.286896 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.compute.api [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127392) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:56:59.293394 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:59.293867 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:59.294333 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:59.295018 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:59.295467 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:59.295886 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:59.327744 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:56:59.328214 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:56:59.328724 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG oslo_concurrency.lockutils [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:56:59.329266 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.objects.instance [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lazy-loading 'fault' on Instance uuid 4b50e0fa-dbc3-4053-98cf-7291cfaab92f {{(pid=127392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 05:56:59.369235 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.policy [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f4eb565bdf49f197d6b2b4a3f17cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c225dfb273d64b3e94f7dae792e4cd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127392) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 05:56:59.376746 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-5ddeb384-f011-4896-9827-5a3601af2718 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 200 len: 1223 microversion: 2.1 time: 0.094602 Oct 04 05:56:59.377297 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 641/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:56:59 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 05:57:00.400377 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '>' {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:57:00.400993 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.compute.api [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] [instance: 4b50e0fa-dbc3-4053-98cf-7291cfaab92f] Fetching instance by UUID {{(pid=127393) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 05:57:00.407573 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:57:00.408054 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:57:00.408519 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:57:00.409266 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Acquiring lock "57801ef0-8805-4133-b9bc-7641eae48053" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 05:57:00.409707 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 05:57:00.410126 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG oslo_concurrency.lockutils [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Lock "57801ef0-8805-4133-b9bc-7641eae48053" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 05:57:00.423193 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.wsgi [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] HTTP exception thrown: Instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f could not be found. Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Request method failure captured: Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: request: GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f HTTP/1.1 Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept: application/json Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Accept-Encoding: identity Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Connection: close Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Length: 0 Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Content-Type: application/json Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Host: 10.222.0.26 Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: Openstack-System-Scope: None Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: User-Agent: python-urllib3/1.26.12 Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Auth-Token: gAAAAABjO8oUNahUEurQnVHc9G90X-WmdHDY_v1wpB2W8Mlgp4-jlZpOmrb_fFWLCyMd1tkhiFFzViFEGTcHwAXaf6eHa_ArIZKxNJJ8_FSEpyfg9zrdE9aIG0nlyCLIMA6Lx5S5deYzvl6fO4mHlOkRyKPWhBkc4ilK2TVXN6cpbCOuZwHR-fQ Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Id: None Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Domain-Name: None Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Identity-Status: Confirmed Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Is-Admin-Project: True Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Id: default Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Domain-Name: Default Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Id: c225dfb273d64b3e94f7dae792e4cd9d Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Project-Name: tempest-TestShelveInstance-1890959676 Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Role: member,reader Oct 04 05:57:00.424847 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Roles: member,reader Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c225dfb273d64b3e94f7dae792e4cd9d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c225dfb273d64b3e94f7dae792e4cd9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c225dfb273d64b3e94f7dae792e4cd9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c225dfb273d64b3e94f7dae792e4cd9d"}]}] Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant: tempest-TestShelveInstance-1890959676 Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Id: c225dfb273d64b3e94f7dae792e4cd9d Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-Tenant-Name: tempest-TestShelveInstance-1890959676 Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User: tempest-TestShelveInstance-1890959676-project Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Id: default Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Domain-Name: Default Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Id: 92f4eb565bdf49f197d6b2b4a3f17cc8 Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: X-User-Name: tempest-TestShelveInstance-1890959676-project Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: method: > Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: exception: Instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f could not be found. Oct 04 05:57:00.426486 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: action_args: {'id': '4b50e0fa-dbc3-4053-98cf-7291cfaab92f'} Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: {{(pid=127393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f could not be found. Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 05:57:00.427659 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f could not be found. Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f could not be found. Oct 04 05:57:00.429386 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: ERROR nova.api.openstack.wsgi Oct 04 05:57:00.431156 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: DEBUG nova.api.openstack.wsgi [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Returning 404 to user: Instance 4b50e0fa-dbc3-4053-98cf-7291cfaab92f could not be found. {{(pid=127393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 05:57:00.431156 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: INFO nova.api.openstack.requestlog [None req-a8a2cf3e-d3d5-48e1-b788-4aad4ea7f531 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f" status: 404 len: 111 microversion: 2.1 time: 0.029760 Oct 04 05:57:00.431156 dv-cinder-849143-10-iscsi devstack@n-api.service[127393]: [pid: 127393|app: 0|req: 620/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 4 05:57:00 2022] GET /compute/v2.1/servers/4b50e0fa-dbc3-4053-98cf-7291cfaab92f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 05:57:00.688872 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: DEBUG nova.api.openstack.wsgi [None req-eb3021df-ea47-48bb-880a-c4fa75ff7890 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] Calling method '.version_select at 0x7f048662edc0>' {{(pid=127392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 05:57:00.777016 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: INFO nova.api.openstack.requestlog [None req-eb3021df-ea47-48bb-880a-c4fa75ff7890 tempest-TestShelveInstance-1890959676 tempest-TestShelveInstance-1890959676-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-518484721" status: 202 len: 0 microversion: 2.1 time: 0.092079 Oct 04 05:57:00.777600 dv-cinder-849143-10-iscsi devstack@n-api.service[127392]: [pid: 127392|app: 0|req: 642/1262] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 4 05:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-518484721 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)